-- Logs begin at Tue 2021-12-14 02:32:15 UTC, end at Tue 2021-12-14 03:38:24 UTC. -- Dec 14 03:06:25.313160 dv-cinder-818037-8-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Dec 14 03:06:25.322970 dv-cinder-818037-8-iscsi devstack@n-api.service[101844]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Dec 14 03:06:25.324288 dv-cinder-818037-8-iscsi devstack@n-api.service[101844]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Dec 14 03:06:25 2021] *** Dec 14 03:06:25.324288 dv-cinder-818037-8-iscsi devstack@n-api.service[101844]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Dec 14 03:06:25.324288 dv-cinder-818037-8-iscsi devstack@n-api.service[101844]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Dec 14 03:06:25.324288 dv-cinder-818037-8-iscsi devstack@n-api.service[101844]: nodename: dv-cinder-818037-8-iscsi Dec 14 03:06:25.324288 dv-cinder-818037-8-iscsi devstack@n-api.service[101844]: machine: x86_64 Dec 14 03:06:25.324288 dv-cinder-818037-8-iscsi devstack@n-api.service[101844]: clock source: unix Dec 14 03:06:25.324288 dv-cinder-818037-8-iscsi devstack@n-api.service[101844]: pcre jit disabled Dec 14 03:06:25.324288 dv-cinder-818037-8-iscsi devstack@n-api.service[101844]: detected number of CPU cores: 4 Dec 14 03:06:25.324288 dv-cinder-818037-8-iscsi devstack@n-api.service[101844]: current working directory: / Dec 14 03:06:25.324288 dv-cinder-818037-8-iscsi devstack@n-api.service[101844]: detected binary path: /usr/bin/uwsgi-core Dec 14 03:06:25.324288 dv-cinder-818037-8-iscsi devstack@n-api.service[101844]: your processes number limit is 47680 Dec 14 03:06:25.324288 dv-cinder-818037-8-iscsi devstack@n-api.service[101844]: your memory page size is 4096 bytes Dec 14 03:06:25.324288 dv-cinder-818037-8-iscsi devstack@n-api.service[101844]: detected max file descriptor number: 2048 Dec 14 03:06:25.324288 dv-cinder-818037-8-iscsi devstack@n-api.service[101844]: lock engine: pthread robust mutexes Dec 14 03:06:25.324288 dv-cinder-818037-8-iscsi devstack@n-api.service[101844]: thunder lock: enabled Dec 14 03:06:25.324288 dv-cinder-818037-8-iscsi devstack@n-api.service[101844]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Dec 14 03:06:25.324288 dv-cinder-818037-8-iscsi devstack@n-api.service[101844]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Dec 14 03:06:25.368413 dv-cinder-818037-8-iscsi devstack@n-api.service[101844]: Python main interpreter initialized at 0x55c6b04e19c0 Dec 14 03:06:25.368413 dv-cinder-818037-8-iscsi devstack@n-api.service[101844]: python threads support enabled Dec 14 03:06:25.368413 dv-cinder-818037-8-iscsi devstack@n-api.service[101844]: your server socket listen backlog is limited to 100 connections Dec 14 03:06:25.368413 dv-cinder-818037-8-iscsi devstack@n-api.service[101844]: your mercy for graceful operations on workers is 90 seconds Dec 14 03:06:25.368782 dv-cinder-818037-8-iscsi devstack@n-api.service[101844]: mapped 403077 bytes (393 KB) for 2 cores Dec 14 03:06:25.368857 dv-cinder-818037-8-iscsi devstack@n-api.service[101844]: *** Operational MODE: preforking *** Dec 14 03:06:25.369094 dv-cinder-818037-8-iscsi devstack@n-api.service[101844]: *** uWSGI is running in multiple interpreter mode *** Dec 14 03:06:25.369094 dv-cinder-818037-8-iscsi devstack@n-api.service[101844]: spawned uWSGI master process (pid: 101844) Dec 14 03:06:25.369293 dv-cinder-818037-8-iscsi systemd[1]: Started Devstack devstack@n-api.service. Dec 14 03:06:25.369844 dv-cinder-818037-8-iscsi devstack@n-api.service[101844]: spawned uWSGI worker 1 (pid: 101845, cores: 1) Dec 14 03:06:25.375065 dv-cinder-818037-8-iscsi devstack@n-api.service[101844]: spawned uWSGI worker 2 (pid: 101846, cores: 1) Dec 14 03:06:25.375065 dv-cinder-818037-8-iscsi devstack@n-api.service[101844]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Dec 14 03:06:27.098055 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 14 03:06:27.098055 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: from cryptography.utils import int_from_bytes Dec 14 03:06:27.098723 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 14 03:06:27.098723 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: from cryptography.utils import int_from_bytes Dec 14 03:06:27.098844 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 14 03:06:27.098844 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: from cryptography.utils import int_from_bytes Dec 14 03:06:27.099421 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 14 03:06:27.099421 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: from cryptography.utils import int_from_bytes Dec 14 03:06:29.682037 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 14 03:06:29.682618 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 14 03:06:29.682969 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 14 03:06:29.683100 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 14 03:06:29.683186 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 14 03:06:29.683268 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 14 03:06:29.683350 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 14 03:06:29.683440 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 14 03:06:29.683528 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 14 03:06:29.683610 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 14 03:06:29.683792 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.683903 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.684163 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.684273 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.684475 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.684578 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.684800 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.684893 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.685133 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.685232 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.685445 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.685529 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.685797 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.685898 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.686087 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.686181 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.686416 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.686498 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.686677 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.686774 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.686994 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.687110 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.687347 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-818037-8-iscsi {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.687438 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-818037-8-iscsi {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.687673 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.687770 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.687982 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.688071 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.688296 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.688384 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.688622 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.688711 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.688934 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.689111 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.689294 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.689516 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.689652 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.689831 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.690082 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.690352 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.690525 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.690653 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.690839 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.690953 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.691187 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.691307 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.691532 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.691662 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.691853 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.691980 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.692171 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.692293 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.692503 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.692667 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.692824 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.692924 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.693168 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.693274 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.693484 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.693590 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.693892 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-818037-8-iscsi {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.693988 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-818037-8-iscsi {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.694212 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.694327 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.694535 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.694642 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.694851 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.694947 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.695293 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.695403 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.695609 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.695793 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.695924 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.696018 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.696251 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.696348 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.696573 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.696666 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.696890 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.696982 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.697223 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.697310 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.697551 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.697643 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.697879 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.697975 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.698207 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.698305 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.698512 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.698598 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.698826 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.698917 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.699162 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.699278 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.699489 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.699587 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.700333 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.700436 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.700649 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.700746 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.700904 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.700998 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.701218 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.701310 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.701545 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.701641 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.701870 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.701960 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.702196 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.702285 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.702449 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.702544 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.702685 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.702779 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.703012 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.703130 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.703361 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.703448 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.703672 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.703768 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.703985 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.704081 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.704295 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.704380 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.704611 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.704725 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.704924 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.705020 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.705234 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.705321 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.705545 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.705689 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.705843 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.705977 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.706162 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.706308 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.706483 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.706631 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.706847 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.706990 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.707168 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.707305 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.707446 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.707592 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.707832 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.707983 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.708116 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.708253 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.708396 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.708528 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.708716 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.708856 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.709038 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.709176 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.709349 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.709504 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.709672 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.709810 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.709994 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.710137 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.710306 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.710459 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.710617 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.710761 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.710927 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.711095 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.711275 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.711430 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.711614 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.711758 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.711921 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.712069 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.712202 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.712347 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.712490 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.712629 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.712788 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.712921 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.713061 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.713203 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.713365 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.713510 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.713677 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.713836 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.713978 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.714116 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.714277 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.714500 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.714643 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.714781 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.714925 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.715090 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.715230 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.715373 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.716151 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.716288 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.716479 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.716613 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.716752 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.716885 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.717017 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.717148 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.717314 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.717454 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.717623 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.717764 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.717943 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.718096 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.718266 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.718416 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.718578 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.718717 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.718884 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.719034 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.719206 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.719339 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.719514 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.719669 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.719836 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.719978 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.720144 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.720288 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.720440 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.720574 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.720766 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.720905 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.721076 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.721221 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.721380 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.721524 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.721698 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.721910 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.722046 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.722177 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.722315 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.722457 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.722590 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.722736 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.722898 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.723059 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.723231 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.723380 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.723550 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.723698 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.723861 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.723999 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.724171 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.724323 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.724549 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.724717 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.724853 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.724994 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.725128 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.725273 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.725415 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.725548 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.725685 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.725827 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.725969 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.726101 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.726252 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.726385 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.726559 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.726698 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.726883 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.727021 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.727204 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.727339 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.727518 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.727664 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.727829 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.727970 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.728135 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.728286 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:06:29.728475 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.728613 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.728806 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.728959 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.729151 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.729299 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.729470 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.729609 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.729804 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.729952 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.730140 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.730289 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.730463 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.730611 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.730778 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.730927 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.731633 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.731776 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.731971 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.732118 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.732288 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.732430 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.732607 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.732747 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.732927 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.733072 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.733250 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.733388 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.733572 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.733715 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.733905 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.734063 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.734212 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.734345 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.734534 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.734752 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.734892 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.735122 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.735275 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.735410 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.735542 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.735675 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.735807 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.735939 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.736123 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.736263 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.736437 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.736576 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.736780 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.736934 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.737374 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.737517 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.737694 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.737832 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.738021 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.738168 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.738339 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.738475 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.738662 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.738807 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.738978 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.739167 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.739314 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.739446 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.739622 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.739763 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.739956 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.740104 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.740272 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.740411 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.740587 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.740725 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.740924 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.741074 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.741242 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.741390 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.741561 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.741698 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.741868 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.742006 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.742174 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.742312 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.742478 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.742617 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.742793 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.742974 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.743134 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.743278 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.743433 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.743581 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.743762 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.743907 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.744069 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.744220 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.744403 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.744540 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.744710 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.744926 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.745065 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.745198 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.745341 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.745555 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.745691 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.745823 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.745954 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.746094 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.746242 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.746385 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.746519 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.746651 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.747388 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.747534 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.747710 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.747871 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.748517 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.748659 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.748795 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.748935 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.749076 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.749224 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.749359 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.749498 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.749637 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.749777 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.749922 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.750057 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.750200 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.750334 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.750465 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.750603 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.750745 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.750885 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.751019 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.751204 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.751355 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.751499 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.751641 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.751781 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.751929 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.752063 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.752195 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.752326 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.752468 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.752601 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.752740 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.752873 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.753005 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.753153 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.753295 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.753436 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.753569 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.753710 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.753842 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.753982 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.754115 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.754256 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.754413 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.754560 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.754727 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.754879 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.755133 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.755283 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.755425 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.755560 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.755709 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.755855 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.755989 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.756121 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.756252 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.756391 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.756551 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.756700 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.756866 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.757015 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.757174 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.757321 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.757468 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.757618 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.757759 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.757898 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.758104 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.758252 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.758400 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.758539 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.758742 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.758888 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.759100 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.759274 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.759429 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.759579 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.759728 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.759874 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.760048 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.760201 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.760351 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.760497 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.760678 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.760825 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.760996 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.761171 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.761312 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.761456 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.761618 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.761758 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.761926 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.762084 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.762225 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.762382 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.762579 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.762725 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.762898 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.763085 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.763245 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.763386 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.763552 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.763709 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.763877 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.764036 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.764184 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.764330 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.764477 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.764617 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.764824 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.764978 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.765171 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.765298 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.765483 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.765635 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.765803 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.765944 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.766111 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.766257 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.766426 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.766576 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.766729 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.766869 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.767094 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.767257 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.767404 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.767545 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.767693 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.767843 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.767983 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.768122 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.768289 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.768434 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.768611 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.768757 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.768924 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.769068 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.769250 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.769407 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.769547 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.769686 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.769870 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.770017 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.770179 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.770335 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.770497 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.770641 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.770830 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.770973 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.771187 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.771347 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.771496 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.771651 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.771808 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.771949 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.772098 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.772246 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.772395 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.772543 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.772711 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.772857 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.773027 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.773174 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.773336 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.773483 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.773644 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.773800 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.773948 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.774086 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.774266 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.774412 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.774582 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.774727 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.774947 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.775137 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.775297 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.775507 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.775652 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.775791 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.775956 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.776099 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.776238 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.776382 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.776524 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.776674 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.776814 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.776953 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.777098 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.777237 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.777375 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.777523 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.777663 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.777817 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.777957 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.778095 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.778264 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.778419 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.778560 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.778699 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.778881 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.779027 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.779221 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.779378 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.779520 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.779666 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.779815 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.779954 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.780105 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.780251 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.780453 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.780611 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.780752 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.780897 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.781069 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.781216 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.781389 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.781533 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.781718 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.781864 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.782033 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.782178 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.782350 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.782500 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.782667 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.782812 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.782981 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.783171 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.783334 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.783480 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.783652 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.783819 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.783968 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.784108 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.784271 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.784417 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.784585 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.784743 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.784884 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.785024 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.785201 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.785354 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.785575 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.785738 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.785889 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.786028 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.786167 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.786304 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.786443 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.786590 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.786730 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.786876 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.787060 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.787211 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.787383 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.787531 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.787957 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.788119 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.788294 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.788440 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.788615 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.788762 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.788941 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.789093 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.789262 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.789415 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.789588 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.789740 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.789920 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.790098 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.790241 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.790380 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.790556 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.790708 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.790849 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.790987 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.791183 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.791335 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.791476 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.791614 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.791787 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.791933 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.792084 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.792235 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.792398 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.792543 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.792707 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.792860 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.793000 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.793146 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.793319 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.793471 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.794158 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.794305 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.794444 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.794602 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.794778 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.794929 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.795094 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.795252 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.795411 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.795563 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.795785 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.795940 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.796081 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.796226 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.796367 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.796520 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.796666 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.796815 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.796956 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.797101 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.797242 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.797381 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.797521 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.797668 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.797815 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.797955 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.798134 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.798281 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.798439 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.798580 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.798778 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.798924 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.799122 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.799269 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.799484 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.799628 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.799768 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.799913 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.800053 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.800192 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.800374 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.800532 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.800672 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.800810 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.800986 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.801131 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.801278 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.801426 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.801598 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.801751 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.801914 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.802077 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.802224 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.802373 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.802513 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.802658 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.802806 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.802960 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.803142 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.803286 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.803453 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.803599 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.803764 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.803918 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.804080 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.804226 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.804378 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.804524 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.804695 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.804848 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.805011 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.805156 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.805317 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.805461 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.805608 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.805749 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.805975 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.806127 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.806268 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.806423 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.806572 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.806719 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.806859 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.806998 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.807178 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.807318 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.807468 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.807609 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.807748 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.807888 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.808027 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.808166 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.808323 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.808463 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.808603 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.808741 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.808921 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.809077 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.809769 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.809921 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.810105 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.810259 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.810423 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.810581 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.810722 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.810871 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.811032 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.811204 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.811369 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.811525 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.811673 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.811812 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.811978 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.812125 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.812290 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.812447 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.812618 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.812780 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.812920 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.813060 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.813214 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.813358 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.813530 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.813676 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.813840 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.813984 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.814131 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.814271 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.814438 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.814591 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.814742 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.814881 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.815029 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.815218 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.815359 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.815498 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.815637 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.815775 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.815925 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.816147 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.816293 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.816434 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.816573 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.816730 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.816871 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.817010 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.817156 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.817297 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.817443 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.817591 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.817732 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.817871 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.818054 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.818201 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.818368 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.818523 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.818730 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.818876 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.819022 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.819202 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.819370 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.819528 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.819693 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.819837 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.820007 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.820151 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.820324 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.820469 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.820644 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.820804 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.820944 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.821082 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.821253 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.821398 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.821569 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.821714 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.821884 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.822029 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.822180 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.822319 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.822485 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.822631 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.822810 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.822954 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.823161 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.823306 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.823456 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.823595 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.823765 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.823911 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.824092 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.824238 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.824418 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.824564 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.824714 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.824893 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.825035 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.825181 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.825353 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.825498 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.825668 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.825827 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.825968 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.826105 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.826328 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.826472 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.826618 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.826778 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.826919 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.827085 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.827232 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.827381 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.827521 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.827669 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.827822 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.827963 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.828102 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.828240 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.828454 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.828596 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.828745 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.828891 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.829031 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.829170 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.829321 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.829468 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.829608 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.829755 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.829895 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.830034 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.830211 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.830358 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.830506 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.830645 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.830824 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.830969 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.831174 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.831317 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.831569 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.831716 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.831887 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.832044 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.832211 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.832353 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.832526 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.832680 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.832820 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.833002 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.833156 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.833296 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.833441 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.833586 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.833728 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.833878 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.834019 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.834183 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.834416 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.834562 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.834718 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.834866 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.835033 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.835200 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.835376 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.835536 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.835684 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.835831 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.835971 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.836109 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.836270 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.836493 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.836648 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.836800 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.836940 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.837085 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.837225 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.837364 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.837511 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.837651 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.837790 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.837935 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.838075 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.838236 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.838387 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.838541 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.838786 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.838931 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.839125 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.839288 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.839431 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.839570 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.839838 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.839984 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.840155 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.840307 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.840488 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.840637 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.840812 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.840958 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.841137 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.841290 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.841465 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.841617 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.841764 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.841910 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.842077 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.842229 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.842393 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.842545 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.842717 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.842879 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.843091 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.843240 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.843380 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.843529 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.843671 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.843810 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.843961 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.844110 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.844288 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.844427 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.844577 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.844728 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.844876 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.845016 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.845203 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.845349 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.845618 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.845766 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.845942 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.846109 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.846264 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.846405 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.846629 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.846783 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.846934 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.847124 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.847286 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.847427 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.847567 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.847706 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.847846 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.847993 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.848134 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.848273 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.848412 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.848550 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.848688 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.848846 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.848988 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.849127 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.849288 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.849435 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.849604 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.849758 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.849900 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.850038 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.850210 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.850356 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.850501 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.850651 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.850835 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.850981 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.851164 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.851312 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.851462 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.851602 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.851777 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.851930 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.852071 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.852210 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.852392 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.852538 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.852699 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.852859 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.853022 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.853174 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.853324 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.853471 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.853612 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.853750 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.853919 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.854066 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.854215 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.854371 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.854553 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.854709 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.854849 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.855001 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.855212 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.855353 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.855514 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.855660 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.855844 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.856505 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.856769 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.856914 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.857054 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.857192 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.857351 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.857500 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.857640 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.857779 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.857917 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.858056 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.858239 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.858395 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.858535 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.858674 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.858839 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.858985 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.859167 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.859280 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.859477 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.859594 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.859788 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.859877 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.860096 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.860186 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.860415 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.860510 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.860722 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.860822 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.861031 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.861194 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.861335 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.861475 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.861647 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.861793 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.861943 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.862328 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.862519 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.862674 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.862815 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.862967 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.863147 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.863291 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.863441 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.863591 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.863732 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.863885 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.864072 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.864219 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.864380 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.864526 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.864717 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.864869 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.865038 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.865183 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.865367 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.865521 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.865697 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.865849 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.866000 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.866139 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.866329 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.866482 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.866653 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.866876 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.867024 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.867201 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.867342 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.867480 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.867644 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.867786 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.867926 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.868064 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.868225 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.868379 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.868563 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.868704 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.868845 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.868983 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.869153 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.869300 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.869496 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.869639 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.869779 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.869919 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.870293 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.870479 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.870625 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.870765 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.870934 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.871129 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.871275 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.871428 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.871592 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.872279 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.872452 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.872607 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.872774 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.872933 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.873075 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.873213 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.873432 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.873586 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.873734 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.873875 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.874015 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.874170 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.874312 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.874488 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.874642 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.874784 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.874955 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.875141 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.875322 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.875468 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.875642 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.875789 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.875963 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.876120 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.876283 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.876448 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.876590 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.876729 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.876953 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.877119 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.877273 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.877414 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.877554 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.877693 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.877842 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.877981 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.878164 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.878319 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.878467 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.878608 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.878787 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.878934 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.879136 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.879285 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.879425 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.879564 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.879740 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.879904 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.880058 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.880199 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.880361 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.880513 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.880681 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.880836 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.881002 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.881148 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.881329 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.881475 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.881669 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.881836 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.881979 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.882119 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.882299 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.882446 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.882618 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.882774 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.882937 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.883109 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.883480 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.883637 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.883787 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.883927 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.884124 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.884271 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.884451 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.884596 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.884778 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.884924 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.885100 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.885246 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.885419 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.885566 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.885748 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.885896 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.886052 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.886200 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.886341 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.886480 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.886655 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.886803 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.886972 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.887170 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.887339 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.887493 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.887643 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.887784 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.887952 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.888109 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.888250 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.888397 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.888576 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.888723 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.888891 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.889037 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.889424 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.889581 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.889769 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.889916 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.890089 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.890237 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.890420 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.890569 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.890749 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.890896 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.891077 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.891226 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.891378 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.891526 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.891708 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.891856 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.892018 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.892165 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.892318 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.892471 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.892635 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.892781 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.892949 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.893096 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.893244 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.893391 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.893538 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.893678 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.893860 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.894016 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.894157 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.894314 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.894456 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.894596 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.894774 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.894929 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.895120 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.895274 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.895415 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.895554 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.895723 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.895879 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.896022 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.896161 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.896314 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.896454 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.896631 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.896786 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.896928 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.897068 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.897234 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.897392 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.897542 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.897862 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.898019 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.898161 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.898302 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.898457 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.898607 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.898755 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.898907 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.899084 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.899248 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.899391 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.899542 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.899692 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.899832 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.899971 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.900111 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.900250 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.900408 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.900549 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.900689 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.900828 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.900979 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.901119 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.901267 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.901408 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.901547 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.901686 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.901832 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.901979 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.902120 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.902276 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.902424 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.902564 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.902715 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.903430 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.903585 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.903736 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.903878 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.904017 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.904362 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.904519 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.904749 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.904906 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.905075 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.905229 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.905420 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.905647 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.905790 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.905930 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.906077 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.906217 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.906365 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.906514 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.906655 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.906795 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.906974 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.907150 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.907303 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.907452 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.907622 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.907782 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.907924 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.908064 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.908241 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.908388 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.908559 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.908745 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.908905 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.909074 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.909217 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.909357 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.909497 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.909637 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.909778 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.909929 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.910070 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.910223 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.910410 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.910565 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.910733 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.910907 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.911123 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.911272 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.911424 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.911566 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.911714 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.911855 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.911995 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.912134 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.912303 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.912450 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.912664 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.912819 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.912959 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.913108 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.913256 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.913398 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.913551 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.913694 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.913836 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.913976 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.914140 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.914310 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.914563 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.914716 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.914874 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.915027 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.915202 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.915354 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.915533 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.915689 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.915851 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.916006 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.916178 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.916335 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.916505 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.916661 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.916813 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.916953 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.917136 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.917282 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.917453 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.917607 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.917784 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.917930 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.918127 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.918275 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.918459 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.919164 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.919348 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.919506 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.919657 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.919798 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.919945 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.920092 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.920248 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.920391 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.920562 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.920717 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.920895 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.921047 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.921232 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.921400 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.921543 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.921682 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.921868 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.922022 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.922173 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.922326 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.922500 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.922646 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.922815 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.922961 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.923161 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.923336 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.923479 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.923618 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.923798 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.923945 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.924113 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.924267 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.924450 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.924597 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.924766 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.924920 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.925070 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.925209 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.925388 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.925542 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.925705 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.925862 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.926011 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.926152 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.926326 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.926481 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.926656 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.926803 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.926985 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.927239 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.927382 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.927546 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.927688 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.927840 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.927975 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.928073 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.928252 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.928343 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.928572 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.928674 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.928890 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.928989 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.929224 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.929382 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.929524 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.929672 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.929845 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.929991 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.930161 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.930308 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.930478 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.930625 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.930796 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.930941 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.931144 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.931303 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.931478 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.931624 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.931806 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.931953 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.932136 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.932283 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.932464 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.932610 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.932812 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.932957 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.933130 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.933276 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.933476 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.933623 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.933807 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.933954 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.934138 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.934298 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.934467 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.934621 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.934762 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.934902 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:06:29.935093 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 14 03:06:29.935255 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 14 03:06:29.957725 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG oslo_db.sqlalchemy.engines [None req-10180921-78f1-4bfd-b025-f923556acf17 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101845) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 14 03:06:29.958596 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG oslo_db.sqlalchemy.engines [None req-92b33f6d-6b6e-4276-bcb2-b973c7664890 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101846) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 14 03:06:30.023529 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.context [None req-10180921-78f1-4bfd-b025-f923556acf17 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8f4f9783-5b67-4c46-a873-d02b5f040c2e(cell1) {{(pid=101845) load_cells /opt/stack/nova/nova/context.py:464}} Dec 14 03:06:30.025048 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.context [None req-92b33f6d-6b6e-4276-bcb2-b973c7664890 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8f4f9783-5b67-4c46-a873-d02b5f040c2e(cell1) {{(pid=101846) load_cells /opt/stack/nova/nova/context.py:464}} Dec 14 03:06:30.027834 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG oslo_concurrency.lockutils [None req-10180921-78f1-4bfd-b025-f923556acf17 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:06:30.029831 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG oslo_concurrency.lockutils [None req-92b33f6d-6b6e-4276-bcb2-b973c7664890 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:06:30.029989 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG oslo_concurrency.lockutils [None req-10180921-78f1-4bfd-b025-f923556acf17 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:06:30.030797 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG oslo_concurrency.lockutils [None req-10180921-78f1-4bfd-b025-f923556acf17 None None] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:06:30.031495 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG oslo_concurrency.lockutils [None req-92b33f6d-6b6e-4276-bcb2-b973c7664890 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:06:30.032297 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG oslo_concurrency.lockutils [None req-92b33f6d-6b6e-4276-bcb2-b973c7664890 None None] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:06:30.032775 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG oslo_concurrency.lockutils [None req-10180921-78f1-4bfd-b025-f923556acf17 None None] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:06:30.034214 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG oslo_concurrency.lockutils [None req-92b33f6d-6b6e-4276-bcb2-b973c7664890 None None] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:06:30.042967 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG oslo_db.sqlalchemy.engines [None req-10180921-78f1-4bfd-b025-f923556acf17 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101845) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 14 03:06:30.046145 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG oslo_db.sqlalchemy.engines [None req-10180921-78f1-4bfd-b025-f923556acf17 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101845) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 14 03:06:30.050054 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG oslo_db.sqlalchemy.engines [None req-92b33f6d-6b6e-4276-bcb2-b973c7664890 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101846) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 14 03:06:30.052308 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG oslo_db.sqlalchemy.engines [None req-92b33f6d-6b6e-4276-bcb2-b973c7664890 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101846) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 14 03:06:30.208463 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG oslo_db.sqlalchemy.engines [None req-10180921-78f1-4bfd-b025-f923556acf17 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101845) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 14 03:06:30.214818 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG oslo_db.sqlalchemy.engines [None req-92b33f6d-6b6e-4276-bcb2-b973c7664890 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101846) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 14 03:06:30.555443 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: WARNING keystonemiddleware.auth_token [None req-10180921-78f1-4bfd-b025-f923556acf17 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 14 03:06:30.560545 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: WARNING keystonemiddleware.auth_token [None req-92b33f6d-6b6e-4276-bcb2-b973c7664890 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 14 03:06:30.562034 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: WARNING keystonemiddleware.auth_token [None req-10180921-78f1-4bfd-b025-f923556acf17 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 14 03:06:30.567222 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: WARNING keystonemiddleware.auth_token [None req-92b33f6d-6b6e-4276-bcb2-b973c7664890 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 14 03:06:30.905974 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: WARNING keystonemiddleware.auth_token [None req-10180921-78f1-4bfd-b025-f923556acf17 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 14 03:06:30.910147 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: WARNING keystonemiddleware.auth_token [None req-92b33f6d-6b6e-4276-bcb2-b973c7664890 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 14 03:06:30.911362 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: WARNING keystonemiddleware.auth_token [None req-10180921-78f1-4bfd-b025-f923556acf17 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 14 03:06:30.915498 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: WARNING keystonemiddleware.auth_token [None req-92b33f6d-6b6e-4276-bcb2-b973c7664890 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 14 03:06:30.916717 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55c6b04e19c0 pid: 101845 (default app) Dec 14 03:06:30.918792 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi [None req-10180921-78f1-4bfd-b025-f923556acf17 None None] Calling method '>' {{(pid=101845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:06:30.920001 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: INFO nova.api.openstack.requestlog [None req-10180921-78f1-4bfd-b025-f923556acf17 None None] 10.222.0.43 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001763 Dec 14 03:06:30.920667 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: [pid: 101845|app: 0|req: 1/1] 10.222.0.43 () {50 vars in 788 bytes} [Tue Dec 14 03:06:30 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:06:30.920769 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55c6b04e19c0 pid: 101846 (default app) Dec 14 03:07:52.417701 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi [None req-10180921-78f1-4bfd-b025-f923556acf17 None None] Calling method '>' {{(pid=101845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:07:52.419362 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: INFO nova.api.openstack.requestlog [None req-10180921-78f1-4bfd-b025-f923556acf17 None None] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002007 Dec 14 03:07:52.419919 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: [pid: 101845|app: 0|req: 2/2] 10.222.0.43 () {54 vars in 930 bytes} [Tue Dec 14 03:07:52 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:07:52.859344 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi [None req-2d1dcb25-f81a-4a20-870d-8b5d801fbe1a admin admin] Calling method '>' {{(pid=101846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:07:52.888907 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: INFO nova.api.openstack.requestlog [None req-2d1dcb25-f81a-4a20-870d-8b5d801fbe1a admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.461899 Dec 14 03:07:52.889846 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: [pid: 101846|app: 0|req: 1/3] 10.222.0.43 () {60 vars in 1291 bytes} [Tue Dec 14 03:07:52 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:07:55.300521 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi [None req-10180921-78f1-4bfd-b025-f923556acf17 None None] Calling method '>' {{(pid=101845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:07:55.301444 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: INFO nova.api.openstack.requestlog [None req-10180921-78f1-4bfd-b025-f923556acf17 None None] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001381 Dec 14 03:07:55.301839 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: [pid: 101845|app: 0|req: 3/4] 10.222.0.43 () {54 vars in 930 bytes} [Tue Dec 14 03:07:55 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 14 03:07:55.363834 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi [None req-1dbb0170-d3ec-4355-9575-b78caac41941 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "ram": 256, "id": "c1", "disk": 1}} {{(pid=101846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:07:55.382501 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:07:55.382501 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: warnings.warn(msg) Dec 14 03:07:55.413538 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: INFO nova.api.openstack.requestlog [None req-1dbb0170-d3ec-4355-9575-b78caac41941 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.104951 Dec 14 03:07:55.414199 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: [pid: 101846|app: 0|req: 2/5] 10.222.0.43 () {64 vars in 1282 bytes} [Tue Dec 14 03:07:55 2021] POST /compute/v2.1/flavors => generated 407 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:07:55.634796 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi [None req-93a59839-eddb-434d-9445-95784babc386 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:07:55.637262 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:07:55.637262 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: warnings.warn(msg) Dec 14 03:07:55.687827 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: INFO nova.api.openstack.requestlog [None req-93a59839-eddb-434d-9445-95784babc386 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.265232 Dec 14 03:07:55.688422 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: [pid: 101845|app: 0|req: 4/6] 10.222.0.43 () {64 vars in 1335 bytes} [Tue Dec 14 03:07:55 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:07:58.222375 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi [None req-1dbb0170-d3ec-4355-9575-b78caac41941 admin admin] Calling method '>' {{(pid=101846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:07:58.223471 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: INFO nova.api.openstack.requestlog [None req-1dbb0170-d3ec-4355-9575-b78caac41941 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Dec 14 03:07:58.224005 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: [pid: 101846|app: 0|req: 3/7] 10.222.0.43 () {54 vars in 930 bytes} [Tue Dec 14 03:07:58 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:07:58.346799 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi [None req-b3a288bf-1cf9-43da-9c35-715cd1a686e8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "ds512M", "swap": 0, "disk": 5, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=101845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:07:58.366980 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:07:58.366980 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: warnings.warn(msg) Dec 14 03:07:58.390926 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: INFO nova.api.openstack.requestlog [None req-b3a288bf-1cf9-43da-9c35-715cd1a686e8 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.159818 Dec 14 03:07:58.391523 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: [pid: 101845|app: 0|req: 5/8] 10.222.0.43 () {64 vars in 1282 bytes} [Tue Dec 14 03:07:58 2021] POST /compute/v2.1/flavors => generated 404 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 14 03:07:58.404029 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi [None req-323a77c0-f3a6-4881-ae19-12817f74cc2c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:07:58.405629 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:07:58.405629 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: warnings.warn(msg) Dec 14 03:07:58.439465 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: INFO nova.api.openstack.requestlog [None req-323a77c0-f3a6-4881-ae19-12817f74cc2c admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039500 Dec 14 03:07:58.440147 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: [pid: 101846|app: 0|req: 4/9] 10.222.0.43 () {64 vars in 1335 bytes} [Tue Dec 14 03:07:58 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:08:00.829667 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi [None req-b3a288bf-1cf9-43da-9c35-715cd1a686e8 admin admin] Calling method '>' {{(pid=101845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:08:00.830671 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: INFO nova.api.openstack.requestlog [None req-b3a288bf-1cf9-43da-9c35-715cd1a686e8 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Dec 14 03:08:00.831092 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: [pid: 101845|app: 0|req: 6/10] 10.222.0.43 () {54 vars in 930 bytes} [Tue Dec 14 03:08:00 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:08:00.890397 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi [None req-92a385a4-4fbe-4449-a311-e926177c67e0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "os-flavor-access:is_public": true, "name": "ds1G", "disk": 10, "swap": 0, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1}} {{(pid=101846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:08:00.910477 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: INFO nova.api.openstack.requestlog [None req-92a385a4-4fbe-4449-a311-e926177c67e0 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.072898 Dec 14 03:08:00.915718 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: [pid: 101846|app: 0|req: 5/11] 10.222.0.43 () {64 vars in 1282 bytes} [Tue Dec 14 03:08:00 2021] POST /compute/v2.1/flavors => generated 404 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:08:00.923302 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi [None req-775399db-572b-4ec7-ba10-7e56554f5bc0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:08:00.947909 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: INFO nova.api.openstack.requestlog [None req-775399db-572b-4ec7-ba10-7e56554f5bc0 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028415 Dec 14 03:08:00.948421 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: [pid: 101845|app: 0|req: 7/12] 10.222.0.43 () {64 vars in 1335 bytes} [Tue Dec 14 03:08:00 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:08:03.341624 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi [None req-92a385a4-4fbe-4449-a311-e926177c67e0 admin admin] Calling method '>' {{(pid=101846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:08:03.342629 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: INFO nova.api.openstack.requestlog [None req-92a385a4-4fbe-4449-a311-e926177c67e0 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Dec 14 03:08:03.343058 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: [pid: 101846|app: 0|req: 6/13] 10.222.0.43 () {54 vars in 930 bytes} [Tue Dec 14 03:08:03 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:08:03.400830 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi [None req-9846ed98-b266-45cf-bc8a-c78d4679e067 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "rxtx_factor": 1.0, "name": "ds2G", "swap": 0, "vcpus": 2, "disk": 10, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048}} {{(pid=101845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:08:03.419736 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: INFO nova.api.openstack.requestlog [None req-9846ed98-b266-45cf-bc8a-c78d4679e067 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.070627 Dec 14 03:08:03.420277 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: [pid: 101845|app: 0|req: 8/14] 10.222.0.43 () {64 vars in 1282 bytes} [Tue Dec 14 03:08:03 2021] POST /compute/v2.1/flavors => generated 404 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:08:03.432844 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi [None req-0b3089ba-3ef7-4c33-9bb8-9bd810faad1b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:08:03.455618 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: INFO nova.api.openstack.requestlog [None req-0b3089ba-3ef7-4c33-9bb8-9bd810faad1b admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027086 Dec 14 03:08:03.456195 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: [pid: 101846|app: 0|req: 7/15] 10.222.0.43 () {64 vars in 1335 bytes} [Tue Dec 14 03:08:03 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:08:05.857075 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi [None req-9846ed98-b266-45cf-bc8a-c78d4679e067 admin admin] Calling method '>' {{(pid=101845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:08:05.858078 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: INFO nova.api.openstack.requestlog [None req-9846ed98-b266-45cf-bc8a-c78d4679e067 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Dec 14 03:08:05.858746 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: [pid: 101845|app: 0|req: 9/16] 10.222.0.43 () {54 vars in 930 bytes} [Tue Dec 14 03:08:05 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:08:05.922050 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi [None req-34c983a6-1ad3-4368-badb-0a5514b9d060 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "rxtx_factor": 1.0, "ram": 4096, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "vcpus": 4, "id": "d4"}} {{(pid=101846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:08:05.941758 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: INFO nova.api.openstack.requestlog [None req-34c983a6-1ad3-4368-badb-0a5514b9d060 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.076398 Dec 14 03:08:05.942846 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: [pid: 101846|app: 0|req: 8/17] 10.222.0.43 () {64 vars in 1282 bytes} [Tue Dec 14 03:08:05 2021] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:08:05.954668 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi [None req-902035ae-0261-4f0a-af66-8e1ee121eab6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:08:05.980558 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: INFO nova.api.openstack.requestlog [None req-902035ae-0261-4f0a-af66-8e1ee121eab6 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029325 Dec 14 03:08:05.981528 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: [pid: 101845|app: 0|req: 10/18] 10.222.0.43 () {64 vars in 1335 bytes} [Tue Dec 14 03:08:05 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 03:08:08.406229 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi [None req-34c983a6-1ad3-4368-badb-0a5514b9d060 admin admin] Calling method '>' {{(pid=101846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:08:08.407789 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: INFO nova.api.openstack.requestlog [None req-34c983a6-1ad3-4368-badb-0a5514b9d060 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002251 Dec 14 03:08:08.408316 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: [pid: 101846|app: 0|req: 9/19] 10.222.0.43 () {54 vars in 930 bytes} [Tue Dec 14 03:08:08 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:08:08.469424 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi [None req-d5f216f8-3f01-4269-b79d-4281943d3f87 admin admin] Calling method '>' {{(pid=101845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:08:08.503670 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: INFO nova.api.openstack.requestlog [None req-d5f216f8-3f01-4269-b79d-4281943d3f87 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.088498 Dec 14 03:08:08.504442 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: [pid: 101845|app: 0|req: 11/20] 10.222.0.43 () {60 vars in 1291 bytes} [Tue Dec 14 03:08:08 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:08:11.948335 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi [None req-34c983a6-1ad3-4368-badb-0a5514b9d060 admin admin] Calling method '>' {{(pid=101846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:08:11.949342 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: INFO nova.api.openstack.requestlog [None req-34c983a6-1ad3-4368-badb-0a5514b9d060 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Dec 14 03:08:11.949741 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: [pid: 101846|app: 0|req: 10/21] 10.222.0.43 () {54 vars in 930 bytes} [Tue Dec 14 03:08:11 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:08:12.010691 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi [None req-e5a3a696-886f-4e61-a563-ca09fe1bd78f admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "rxtx_factor": 1.0, "disk": 1, "name": "m1.tiny", "os-flavor-access:is_public": true, "id": "1", "ram": 512}} {{(pid=101845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:08:12.030420 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: INFO nova.api.openstack.requestlog [None req-e5a3a696-886f-4e61-a563-ca09fe1bd78f admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.074095 Dec 14 03:08:12.031006 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: [pid: 101845|app: 0|req: 12/22] 10.222.0.43 () {64 vars in 1282 bytes} [Tue Dec 14 03:08:11 2021] POST /compute/v2.1/flavors => generated 402 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:08:12.044251 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi [None req-dcf40c88-d8ed-4283-bb9e-bdd250158cfb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:08:12.070826 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: INFO nova.api.openstack.requestlog [None req-dcf40c88-d8ed-4283-bb9e-bdd250158cfb admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030882 Dec 14 03:08:12.071449 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: [pid: 101846|app: 0|req: 11/23] 10.222.0.43 () {64 vars in 1332 bytes} [Tue Dec 14 03:08:12 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:08:14.457648 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi [None req-e5a3a696-886f-4e61-a563-ca09fe1bd78f admin admin] Calling method '>' {{(pid=101845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:08:14.458649 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: INFO nova.api.openstack.requestlog [None req-e5a3a696-886f-4e61-a563-ca09fe1bd78f admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Dec 14 03:08:14.459070 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: [pid: 101845|app: 0|req: 13/24] 10.222.0.43 () {54 vars in 930 bytes} [Tue Dec 14 03:08:14 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:08:14.516990 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi [None req-8511df0a-3108-49e4-905b-0e65b473237c admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "name": "m1.small", "disk": 20, "vcpus": 1}} {{(pid=101846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:08:14.535742 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: INFO nova.api.openstack.requestlog [None req-8511df0a-3108-49e4-905b-0e65b473237c admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.070328 Dec 14 03:08:14.536302 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: [pid: 101846|app: 0|req: 12/25] 10.222.0.43 () {64 vars in 1282 bytes} [Tue Dec 14 03:08:14 2021] POST /compute/v2.1/flavors => generated 405 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:08:14.548232 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi [None req-ec8d1ae0-6091-4570-a61d-90cc5fbb1afc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:08:14.568914 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: INFO nova.api.openstack.requestlog [None req-ec8d1ae0-6091-4570-a61d-90cc5fbb1afc admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024236 Dec 14 03:08:14.569470 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: [pid: 101845|app: 0|req: 14/26] 10.222.0.43 () {64 vars in 1332 bytes} [Tue Dec 14 03:08:14 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:08:16.973117 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi [None req-8511df0a-3108-49e4-905b-0e65b473237c admin admin] Calling method '>' {{(pid=101846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:08:16.974123 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: INFO nova.api.openstack.requestlog [None req-8511df0a-3108-49e4-905b-0e65b473237c admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Dec 14 03:08:16.974530 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: [pid: 101846|app: 0|req: 13/27] 10.222.0.43 () {54 vars in 930 bytes} [Tue Dec 14 03:08:16 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:08:17.042881 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi [None req-93402287-5216-4ea8-9e52-653c438904f1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.medium", "disk": 40, "vcpus": 2, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "ram": 4096, "swap": 0}} {{(pid=101845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:08:17.064709 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: INFO nova.api.openstack.requestlog [None req-93402287-5216-4ea8-9e52-653c438904f1 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.083248 Dec 14 03:08:17.065263 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: [pid: 101845|app: 0|req: 15/28] 10.222.0.43 () {64 vars in 1282 bytes} [Tue Dec 14 03:08:16 2021] POST /compute/v2.1/flavors => generated 406 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:08:17.077768 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi [None req-61af8f36-df41-416e-89fb-aac523a48608 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:08:17.102714 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: INFO nova.api.openstack.requestlog [None req-61af8f36-df41-416e-89fb-aac523a48608 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028393 Dec 14 03:08:17.115363 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: [pid: 101846|app: 0|req: 14/29] 10.222.0.43 () {64 vars in 1332 bytes} [Tue Dec 14 03:08:17 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 03:08:19.488601 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi [None req-93402287-5216-4ea8-9e52-653c438904f1 admin admin] Calling method '>' {{(pid=101845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:08:19.489654 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: INFO nova.api.openstack.requestlog [None req-93402287-5216-4ea8-9e52-653c438904f1 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Dec 14 03:08:19.490064 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: [pid: 101845|app: 0|req: 16/30] 10.222.0.43 () {54 vars in 930 bytes} [Tue Dec 14 03:08:19 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:08:19.549893 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi [None req-eb9667d6-d05a-482e-9c70-2d108c4ee137 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 8192, "os-flavor-access:is_public": true, "id": "4", "disk": 80, "name": "m1.large"}} {{(pid=101846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:08:19.569895 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: INFO nova.api.openstack.requestlog [None req-eb9667d6-d05a-482e-9c70-2d108c4ee137 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.073337 Dec 14 03:08:19.570576 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: [pid: 101846|app: 0|req: 15/31] 10.222.0.43 () {64 vars in 1282 bytes} [Tue Dec 14 03:08:19 2021] POST /compute/v2.1/flavors => generated 405 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:08:19.582569 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi [None req-43e505d7-8375-4045-b9b7-ded7f68f1d77 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:08:19.618989 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: INFO nova.api.openstack.requestlog [None req-43e505d7-8375-4045-b9b7-ded7f68f1d77 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039918 Dec 14 03:08:19.627275 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: [pid: 101845|app: 0|req: 17/32] 10.222.0.43 () {64 vars in 1332 bytes} [Tue Dec 14 03:08:19 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:08:22.018502 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi [None req-eb9667d6-d05a-482e-9c70-2d108c4ee137 admin admin] Calling method '>' {{(pid=101846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:08:22.019543 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: INFO nova.api.openstack.requestlog [None req-eb9667d6-d05a-482e-9c70-2d108c4ee137 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Dec 14 03:08:22.020222 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: [pid: 101846|app: 0|req: 16/33] 10.222.0.43 () {54 vars in 930 bytes} [Tue Dec 14 03:08:22 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:08:22.094972 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi [None req-c135478f-ebe5-49cb-8b56-5790213bd612 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 8, "id": "5", "disk": 160, "swap": 0}} {{(pid=101845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:08:22.117962 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: INFO nova.api.openstack.requestlog [None req-c135478f-ebe5-49cb-8b56-5790213bd612 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.090725 Dec 14 03:08:22.126868 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: [pid: 101845|app: 0|req: 18/34] 10.222.0.43 () {64 vars in 1282 bytes} [Tue Dec 14 03:08:22 2021] POST /compute/v2.1/flavors => generated 408 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 14 03:08:22.132026 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi [None req-670aeb50-a68e-4dcf-b295-53860bd3fe60 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:08:22.166126 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: INFO nova.api.openstack.requestlog [None req-670aeb50-a68e-4dcf-b295-53860bd3fe60 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037764 Dec 14 03:08:22.167088 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: [pid: 101846|app: 0|req: 17/35] 10.222.0.43 () {64 vars in 1332 bytes} [Tue Dec 14 03:08:22 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:08:42.424189 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi [None req-c135478f-ebe5-49cb-8b56-5790213bd612 admin admin] Calling method '>' {{(pid=101845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:08:42.425176 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: INFO nova.api.openstack.requestlog [None req-c135478f-ebe5-49cb-8b56-5790213bd612 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 Dec 14 03:08:42.425573 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: [pid: 101845|app: 0|req: 19/36] 10.222.0.43 () {54 vars in 930 bytes} [Tue Dec 14 03:08:42 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:08:42.481400 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi [None req-15d6a35e-7a95-4746-bfcd-5dfe4d5c59ad admin admin] Calling method '>' {{(pid=101846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:08:42.498449 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: INFO nova.api.openstack.requestlog [None req-15d6a35e-7a95-4746-bfcd-5dfe4d5c59ad admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.065853 Dec 14 03:08:42.498980 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: [pid: 101846|app: 0|req: 18/37] 10.222.0.43 () {60 vars in 1291 bytes} [Tue Dec 14 03:08:42 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:08:44.141652 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi [None req-c135478f-ebe5-49cb-8b56-5790213bd612 admin admin] Calling method '>' {{(pid=101845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:08:44.142666 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: INFO nova.api.openstack.requestlog [None req-c135478f-ebe5-49cb-8b56-5790213bd612 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Dec 14 03:08:44.143090 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: [pid: 101845|app: 0|req: 20/38] 10.222.0.43 () {56 vars in 1074 bytes} [Tue Dec 14 03:08:44 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:08:44.332896 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi [None req-c019b3ca-4c7d-426e-aa4e-c0ca0c9d427a admin admin] Calling method '>' {{(pid=101846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:08:44.338512 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: INFO nova.api.openstack.wsgi [None req-c019b3ca-4c7d-426e-aa4e-c0ca0c9d427a admin admin] HTTP exception thrown: Flavor 42 could not be found. Dec 14 03:08:44.339102 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi [None req-c019b3ca-4c7d-426e-aa4e-c0ca0c9d427a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 03:08:44.339888 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: INFO nova.api.openstack.requestlog [None req-c019b3ca-4c7d-426e-aa4e-c0ca0c9d427a admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.057834 Dec 14 03:08:44.340392 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: [pid: 101846|app: 0|req: 19/39] 10.222.0.43 () {60 vars in 1190 bytes} [Tue Dec 14 03:08:44 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 14 03:08:44.350203 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi [None req-6d249b24-f167-4db1-9e70-3514d586db16 admin admin] Calling method '>' {{(pid=101845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:08:44.371911 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: INFO nova.api.openstack.requestlog [None req-6d249b24-f167-4db1-9e70-3514d586db16 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025321 Dec 14 03:08:44.372452 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: [pid: 101845|app: 0|req: 21/40] 10.222.0.43 () {60 vars in 1210 bytes} [Tue Dec 14 03:08:44 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:08:44.382665 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi [None req-3b96044d-76f5-4f7d-bff3-e7e828a9c23a admin admin] Calling method '>' {{(pid=101846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:08:44.403942 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: INFO nova.api.openstack.requestlog [None req-3b96044d-76f5-4f7d-bff3-e7e828a9c23a admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024899 Dec 14 03:08:44.404500 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: [pid: 101846|app: 0|req: 20/41] 10.222.0.43 () {60 vars in 1210 bytes} [Tue Dec 14 03:08:44 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:08:44.414479 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi [None req-4e65ea43-df73-4a2e-b0df-ac1fdb5135fe admin admin] Calling method '>' {{(pid=101845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:08:44.421494 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: INFO nova.api.openstack.wsgi [None req-4e65ea43-df73-4a2e-b0df-ac1fdb5135fe admin admin] HTTP exception thrown: Flavor 42 could not be found. Dec 14 03:08:44.422065 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi [None req-4e65ea43-df73-4a2e-b0df-ac1fdb5135fe admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 03:08:44.423679 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: INFO nova.api.openstack.requestlog [None req-4e65ea43-df73-4a2e-b0df-ac1fdb5135fe admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.012030 Dec 14 03:08:44.424189 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: [pid: 101845|app: 0|req: 22/42] 10.222.0.43 () {60 vars in 1190 bytes} [Tue Dec 14 03:08:44 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 14 03:08:45.914311 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi [None req-3b96044d-76f5-4f7d-bff3-e7e828a9c23a admin admin] Calling method '>' {{(pid=101846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:08:45.915349 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: INFO nova.api.openstack.requestlog [None req-3b96044d-76f5-4f7d-bff3-e7e828a9c23a admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Dec 14 03:08:45.915748 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: [pid: 101846|app: 0|req: 21/43] 10.222.0.43 () {56 vars in 1074 bytes} [Tue Dec 14 03:08:45 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:08:46.104533 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi [None req-10ca422f-2073-4c4a-9770-e035e0724721 admin admin] Calling method '>' {{(pid=101845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:08:46.109577 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: INFO nova.api.openstack.wsgi [None req-10ca422f-2073-4c4a-9770-e035e0724721 admin admin] HTTP exception thrown: Flavor 84 could not be found. Dec 14 03:08:46.110133 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi [None req-10ca422f-2073-4c4a-9770-e035e0724721 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 03:08:46.110927 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: INFO nova.api.openstack.requestlog [None req-10ca422f-2073-4c4a-9770-e035e0724721 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.057492 Dec 14 03:08:46.111475 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: [pid: 101845|app: 0|req: 23/44] 10.222.0.43 () {60 vars in 1190 bytes} [Tue Dec 14 03:08:46 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 14 03:08:46.121856 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi [None req-72f3ccfd-2a10-4910-a4f8-41b9086da141 admin admin] Calling method '>' {{(pid=101846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:08:46.135317 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: INFO nova.api.openstack.requestlog [None req-72f3ccfd-2a10-4910-a4f8-41b9086da141 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016837 Dec 14 03:08:46.135799 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: [pid: 101846|app: 0|req: 22/45] 10.222.0.43 () {60 vars in 1210 bytes} [Tue Dec 14 03:08:46 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:08:46.145521 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi [None req-2d62d17f-6bcf-491a-9f15-19b52e4cd954 admin admin] Calling method '>' {{(pid=101845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:08:46.158625 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: INFO nova.api.openstack.requestlog [None req-2d62d17f-6bcf-491a-9f15-19b52e4cd954 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016521 Dec 14 03:08:46.159167 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: [pid: 101845|app: 0|req: 24/46] 10.222.0.43 () {60 vars in 1210 bytes} [Tue Dec 14 03:08:46 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:08:46.168932 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi [None req-b5c2fe29-2196-4985-b19a-2c55b54c0427 admin admin] Calling method '>' {{(pid=101846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:08:46.173969 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: INFO nova.api.openstack.wsgi [None req-b5c2fe29-2196-4985-b19a-2c55b54c0427 admin admin] HTTP exception thrown: Flavor 84 could not be found. Dec 14 03:08:46.174533 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi [None req-b5c2fe29-2196-4985-b19a-2c55b54c0427 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 03:08:46.175347 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: INFO nova.api.openstack.requestlog [None req-b5c2fe29-2196-4985-b19a-2c55b54c0427 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.009794 Dec 14 03:08:46.175841 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: [pid: 101846|app: 0|req: 23/47] 10.222.0.43 () {60 vars in 1190 bytes} [Tue Dec 14 03:08:46 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 14 03:08:47.651624 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi [None req-2d62d17f-6bcf-491a-9f15-19b52e4cd954 admin admin] Calling method '>' {{(pid=101845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:08:47.652647 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: INFO nova.api.openstack.requestlog [None req-2d62d17f-6bcf-491a-9f15-19b52e4cd954 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Dec 14 03:08:47.653036 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: [pid: 101845|app: 0|req: 25/48] 10.222.0.43 () {56 vars in 1074 bytes} [Tue Dec 14 03:08:47 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:08:47.840562 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi [None req-9d5b402e-bf04-4d55-b7dd-d050118d4c9d admin admin] Calling method '>' {{(pid=101846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:08:47.845967 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: INFO nova.api.openstack.wsgi [None req-9d5b402e-bf04-4d55-b7dd-d050118d4c9d admin admin] HTTP exception thrown: Flavor 451 could not be found. Dec 14 03:08:47.846527 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi [None req-9d5b402e-bf04-4d55-b7dd-d050118d4c9d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 03:08:47.847359 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: INFO nova.api.openstack.requestlog [None req-9d5b402e-bf04-4d55-b7dd-d050118d4c9d admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.057027 Dec 14 03:08:47.847859 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: [pid: 101846|app: 0|req: 24/49] 10.222.0.43 () {60 vars in 1193 bytes} [Tue Dec 14 03:08:47 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 14 03:08:47.858154 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi [None req-e5e7228c-e91c-4c2e-a4d6-52e0853029e4 admin admin] Calling method '>' {{(pid=101845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:08:47.871439 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: INFO nova.api.openstack.requestlog [None req-e5e7228c-e91c-4c2e-a4d6-52e0853029e4 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016741 Dec 14 03:08:47.871949 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: [pid: 101845|app: 0|req: 26/50] 10.222.0.43 () {60 vars in 1210 bytes} [Tue Dec 14 03:08:47 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:08:47.882970 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi [None req-1f745ae4-2752-47ee-b3ce-f94a0fbc1616 admin admin] Calling method '>' {{(pid=101846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:08:47.895441 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: INFO nova.api.openstack.requestlog [None req-1f745ae4-2752-47ee-b3ce-f94a0fbc1616 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017359 Dec 14 03:08:47.895955 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: [pid: 101846|app: 0|req: 25/51] 10.222.0.43 () {60 vars in 1210 bytes} [Tue Dec 14 03:08:47 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:08:47.905884 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi [None req-b126adaa-2a14-47b3-9ae8-6cfb88f0700c admin admin] Calling method '>' {{(pid=101845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:08:47.910924 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: INFO nova.api.openstack.wsgi [None req-b126adaa-2a14-47b3-9ae8-6cfb88f0700c admin admin] HTTP exception thrown: Flavor 451 could not be found. Dec 14 03:08:47.911514 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi [None req-b126adaa-2a14-47b3-9ae8-6cfb88f0700c admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 03:08:47.912290 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: INFO nova.api.openstack.requestlog [None req-b126adaa-2a14-47b3-9ae8-6cfb88f0700c admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.009868 Dec 14 03:08:47.912782 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: [pid: 101845|app: 0|req: 27/52] 10.222.0.43 () {60 vars in 1193 bytes} [Tue Dec 14 03:08:47 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Dec 14 03:08:49.392008 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi [None req-1f745ae4-2752-47ee-b3ce-f94a0fbc1616 admin admin] Calling method '>' {{(pid=101846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:08:49.393014 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: INFO nova.api.openstack.requestlog [None req-1f745ae4-2752-47ee-b3ce-f94a0fbc1616 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Dec 14 03:08:49.393411 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: [pid: 101846|app: 0|req: 26/53] 10.222.0.43 () {56 vars in 1074 bytes} [Tue Dec 14 03:08:49 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:08:49.582665 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi [None req-b7a57eb4-8463-491b-8b81-a3a05bb70c6e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:08:49.603244 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: INFO nova.api.openstack.requestlog [None req-b7a57eb4-8463-491b-8b81-a3a05bb70c6e admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.071820 Dec 14 03:08:49.603720 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: [pid: 101845|app: 0|req: 28/54] 10.222.0.43 () {64 vars in 1235 bytes} [Tue Dec 14 03:08:49 2021] POST /compute/v2.1/flavors => generated 404 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:08:51.072670 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi [None req-1f745ae4-2752-47ee-b3ce-f94a0fbc1616 admin admin] Calling method '>' {{(pid=101846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:08:51.073698 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: INFO nova.api.openstack.requestlog [None req-1f745ae4-2752-47ee-b3ce-f94a0fbc1616 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Dec 14 03:08:51.074090 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: [pid: 101846|app: 0|req: 27/55] 10.222.0.43 () {56 vars in 1074 bytes} [Tue Dec 14 03:08:51 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:08:51.261980 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi [None req-c31b5d7b-e4ea-4e81-b0d3-34e6c7d8b63f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:08:51.278931 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: INFO nova.api.openstack.requestlog [None req-c31b5d7b-e4ea-4e81-b0d3-34e6c7d8b63f admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.067867 Dec 14 03:08:51.279499 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: [pid: 101845|app: 0|req: 29/56] 10.222.0.43 () {64 vars in 1235 bytes} [Tue Dec 14 03:08:51 2021] POST /compute/v2.1/flavors => generated 405 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:08:52.754058 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi [None req-1f745ae4-2752-47ee-b3ce-f94a0fbc1616 admin admin] Calling method '>' {{(pid=101846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:08:52.755084 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: INFO nova.api.openstack.requestlog [None req-1f745ae4-2752-47ee-b3ce-f94a0fbc1616 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001403 Dec 14 03:08:52.755483 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: [pid: 101846|app: 0|req: 28/57] 10.222.0.43 () {56 vars in 1074 bytes} [Tue Dec 14 03:08:52 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:08:52.946725 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi [None req-4a760be7-fc06-454f-932a-9b0c4881bf61 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:08:52.964263 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: INFO nova.api.openstack.requestlog [None req-4a760be7-fc06-454f-932a-9b0c4881bf61 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.068328 Dec 14 03:08:52.964793 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: [pid: 101845|app: 0|req: 30/58] 10.222.0.43 () {64 vars in 1235 bytes} [Tue Dec 14 03:08:52 2021] POST /compute/v2.1/flavors => generated 407 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:08:54.454818 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi [None req-1f745ae4-2752-47ee-b3ce-f94a0fbc1616 admin admin] Calling method '>' {{(pid=101846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:08:54.455845 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: INFO nova.api.openstack.requestlog [None req-1f745ae4-2752-47ee-b3ce-f94a0fbc1616 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Dec 14 03:08:54.456237 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: [pid: 101846|app: 0|req: 29/59] 10.222.0.43 () {56 vars in 1074 bytes} [Tue Dec 14 03:08:54 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:08:54.646948 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi [None req-3f8a22f6-8499-4fe9-9fdb-89c83ef9aae4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:08:54.665886 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: INFO nova.api.openstack.requestlog [None req-3f8a22f6-8499-4fe9-9fdb-89c83ef9aae4 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.070113 Dec 14 03:08:54.666376 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: [pid: 101845|app: 0|req: 31/60] 10.222.0.43 () {64 vars in 1235 bytes} [Tue Dec 14 03:08:54 2021] POST /compute/v2.1/flavors => generated 409 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 14 03:08:56.150419 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi [None req-1f745ae4-2752-47ee-b3ce-f94a0fbc1616 admin admin] Calling method '>' {{(pid=101846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:08:56.151491 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: INFO nova.api.openstack.requestlog [None req-1f745ae4-2752-47ee-b3ce-f94a0fbc1616 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001401 Dec 14 03:08:56.151880 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: [pid: 101846|app: 0|req: 30/61] 10.222.0.43 () {56 vars in 1074 bytes} [Tue Dec 14 03:08:56 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:08:56.338856 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi [None req-4773ed0e-ed4a-4e93-8e62-a5a5871d8e53 admin admin] Calling method '>' {{(pid=101845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:08:56.358036 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: INFO nova.api.openstack.requestlog [None req-4773ed0e-ed4a-4e93-8e62-a5a5871d8e53 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.069981 Dec 14 03:08:56.358626 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: [pid: 101845|app: 0|req: 32/62] 10.222.0.43 () {60 vars in 1202 bytes} [Tue Dec 14 03:08:56 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:09:43.881090 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi [None req-1f745ae4-2752-47ee-b3ce-f94a0fbc1616 admin admin] Calling method '>' {{(pid=101846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:09:43.882080 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: INFO nova.api.openstack.requestlog [None req-1f745ae4-2752-47ee-b3ce-f94a0fbc1616 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001398 Dec 14 03:09:43.882470 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: [pid: 101846|app: 0|req: 31/63] 10.222.0.43 () {54 vars in 930 bytes} [Tue Dec 14 03:09:43 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:09:43.940053 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi [None req-c315ad4c-110d-4991-a014-0577a5b2365b admin admin] Calling method '>' {{(pid=101845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:09:43.958839 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: INFO nova.api.openstack.requestlog [None req-c315ad4c-110d-4991-a014-0577a5b2365b admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.069920 Dec 14 03:09:43.959403 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: [pid: 101845|app: 0|req: 33/64] 10.222.0.43 () {60 vars in 1291 bytes} [Tue Dec 14 03:09:43 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:09:43.981812 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi [None req-c9c1a46d-b4f8-4b0d-9022-626058555946 admin admin] Calling method '>' {{(pid=101846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:09:43.989691 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: INFO nova.api.openstack.requestlog [None req-c9c1a46d-b4f8-4b0d-9022-626058555946 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011420 Dec 14 03:09:43.990202 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: [pid: 101846|app: 0|req: 32/65] 10.222.0.43 () {60 vars in 1282 bytes} [Tue Dec 14 03:09:43 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 03:09:44.002243 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi [None req-0dc03486-037c-4533-997f-d612d5802480 admin admin] Calling method '>' {{(pid=101845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:09:44.009719 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: INFO nova.api.openstack.requestlog [None req-0dc03486-037c-4533-997f-d612d5802480 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010947 Dec 14 03:09:44.010229 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: [pid: 101845|app: 0|req: 34/66] 10.222.0.43 () {60 vars in 1285 bytes} [Tue Dec 14 03:09:43 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:09:44.021474 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi [None req-887b2caf-0b94-4237-82d3-b2853c2a0468 admin admin] Calling method '>' {{(pid=101846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:09:44.028750 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: INFO nova.api.openstack.requestlog [None req-887b2caf-0b94-4237-82d3-b2853c2a0468 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010671 Dec 14 03:09:44.029261 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: [pid: 101846|app: 0|req: 33/67] 10.222.0.43 () {60 vars in 1285 bytes} [Tue Dec 14 03:09:44 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 03:09:44.040919 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi [None req-01b269e2-7c83-4f0d-ab83-9fc9d9015384 admin admin] Calling method '>' {{(pid=101845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:09:44.048279 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: INFO nova.api.openstack.requestlog [None req-01b269e2-7c83-4f0d-ab83-9fc9d9015384 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011132 Dec 14 03:09:44.048800 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: [pid: 101845|app: 0|req: 35/68] 10.222.0.43 () {60 vars in 1282 bytes} [Tue Dec 14 03:09:44 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 03:11:06.571533 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi [None req-15ce915e-aae8-45f6-9422-29c9c6af904d tempest-verify_tempest_config-1247779946 tempest-verify_tempest_config-1247779946-project] Calling method '>' {{(pid=101846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:11:06.573514 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: INFO nova.api.openstack.requestlog [None req-15ce915e-aae8-45f6-9422-29c9c6af904d tempest-verify_tempest_config-1247779946 tempest-verify_tempest_config-1247779946-project] 10.222.0.43 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.103849 Dec 14 03:11:06.574043 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: [pid: 101846|app: 0|req: 34/69] 10.222.0.43 () {58 vars in 1133 bytes} [Tue Dec 14 03:11:06 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:12:35.652194 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi [None req-01b269e2-7c83-4f0d-ab83-9fc9d9015384 admin admin] Calling method '>' {{(pid=101845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:12:35.653196 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: INFO nova.api.openstack.requestlog [None req-01b269e2-7c83-4f0d-ab83-9fc9d9015384 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Dec 14 03:12:35.653596 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: [pid: 101845|app: 0|req: 36/70] 10.222.0.43 () {56 vars in 1074 bytes} [Tue Dec 14 03:12:35 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:12:35.917733 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi [None req-4e703445-270d-4509-8f09-afe83c767451 admin admin] Calling method '>' {{(pid=101846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:12:35.918995 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:12:35.918995 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: warnings.warn(msg) Dec 14 03:12:35.920572 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG oslo_concurrency.lockutils [None req-4e703445-270d-4509-8f09-afe83c767451 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:12:35.921021 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG oslo_concurrency.lockutils [None req-4e703445-270d-4509-8f09-afe83c767451 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:12:35.921847 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG oslo_concurrency.lockutils [None req-4e703445-270d-4509-8f09-afe83c767451 admin admin] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:12:35.922280 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG oslo_concurrency.lockutils [None req-4e703445-270d-4509-8f09-afe83c767451 admin admin] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:12:35.954239 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: INFO nova.api.openstack.requestlog [None req-4e703445-270d-4509-8f09-afe83c767451 admin admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.152616 Dec 14 03:12:35.954784 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: [pid: 101846|app: 0|req: 35/71] 10.222.0.43 () {60 vars in 1193 bytes} [Tue Dec 14 03:12:35 2021] GET /compute/v2.1/os-services => generated 791 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:12:37.442922 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi [None req-01b269e2-7c83-4f0d-ab83-9fc9d9015384 admin admin] Calling method '>' {{(pid=101845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:12:37.443935 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: INFO nova.api.openstack.requestlog [None req-01b269e2-7c83-4f0d-ab83-9fc9d9015384 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Dec 14 03:12:37.444326 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: [pid: 101845|app: 0|req: 37/72] 10.222.0.43 () {56 vars in 1074 bytes} [Tue Dec 14 03:12:37 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:12:37.633063 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi [None req-0327b4bb-ff27-4a45-8549-05388a5d326f admin admin] Calling method '>' {{(pid=101846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:12:37.634215 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:12:37.634215 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: warnings.warn(msg) Dec 14 03:12:37.635784 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG oslo_concurrency.lockutils [None req-0327b4bb-ff27-4a45-8549-05388a5d326f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:12:37.636231 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG oslo_concurrency.lockutils [None req-0327b4bb-ff27-4a45-8549-05388a5d326f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:12:37.637022 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG oslo_concurrency.lockutils [None req-0327b4bb-ff27-4a45-8549-05388a5d326f admin admin] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:12:37.637473 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG oslo_concurrency.lockutils [None req-0327b4bb-ff27-4a45-8549-05388a5d326f admin admin] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:12:37.656549 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: INFO nova.api.openstack.requestlog [None req-0327b4bb-ff27-4a45-8549-05388a5d326f admin admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.075005 Dec 14 03:12:37.657031 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: [pid: 101846|app: 0|req: 36/73] 10.222.0.43 () {60 vars in 1193 bytes} [Tue Dec 14 03:12:37 2021] GET /compute/v2.1/os-services => generated 791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:12:49.560137 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi [None req-01b269e2-7c83-4f0d-ab83-9fc9d9015384 admin admin] Calling method '>' {{(pid=101845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:12:49.561160 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: INFO nova.api.openstack.requestlog [None req-01b269e2-7c83-4f0d-ab83-9fc9d9015384 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Dec 14 03:12:49.561556 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: [pid: 101845|app: 0|req: 38/74] 10.222.0.43 () {56 vars in 1074 bytes} [Tue Dec 14 03:12:49 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:12:49.754242 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi [None req-147bbeb7-0aa9-49bd-9f6f-a059b3cfa474 admin admin] Calling method '>' {{(pid=101846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:12:49.755439 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:12:49.755439 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: warnings.warn(msg) Dec 14 03:12:49.757532 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG oslo_concurrency.lockutils [None req-147bbeb7-0aa9-49bd-9f6f-a059b3cfa474 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:12:49.757981 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG oslo_concurrency.lockutils [None req-147bbeb7-0aa9-49bd-9f6f-a059b3cfa474 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:12:49.758787 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG oslo_concurrency.lockutils [None req-147bbeb7-0aa9-49bd-9f6f-a059b3cfa474 admin admin] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:12:49.759262 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG oslo_concurrency.lockutils [None req-147bbeb7-0aa9-49bd-9f6f-a059b3cfa474 admin admin] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:12:49.783663 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: INFO nova.api.openstack.requestlog [None req-147bbeb7-0aa9-49bd-9f6f-a059b3cfa474 admin admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.080484 Dec 14 03:12:49.784151 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: [pid: 101846|app: 0|req: 37/75] 10.222.0.43 () {60 vars in 1193 bytes} [Tue Dec 14 03:12:49 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:12:51.277119 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: DEBUG nova.api.openstack.wsgi [None req-01b269e2-7c83-4f0d-ab83-9fc9d9015384 admin admin] Calling method '>' {{(pid=101845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:12:51.278120 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: INFO nova.api.openstack.requestlog [None req-01b269e2-7c83-4f0d-ab83-9fc9d9015384 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 Dec 14 03:12:51.278525 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: [pid: 101845|app: 0|req: 39/76] 10.222.0.43 () {56 vars in 1074 bytes} [Tue Dec 14 03:12:51 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:12:51.494573 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG nova.api.openstack.wsgi [None req-b250b36c-a638-45dc-af70-b56c1ef6072c admin admin] Calling method '>' {{(pid=101846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:12:51.495973 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:12:51.495973 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: warnings.warn(msg) Dec 14 03:12:51.497569 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG oslo_concurrency.lockutils [None req-b250b36c-a638-45dc-af70-b56c1ef6072c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:12:51.498007 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG oslo_concurrency.lockutils [None req-b250b36c-a638-45dc-af70-b56c1ef6072c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:12:51.498933 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG oslo_concurrency.lockutils [None req-b250b36c-a638-45dc-af70-b56c1ef6072c admin admin] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:12:51.499388 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: DEBUG oslo_concurrency.lockutils [None req-b250b36c-a638-45dc-af70-b56c1ef6072c admin admin] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:12:51.520565 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: INFO nova.api.openstack.requestlog [None req-b250b36c-a638-45dc-af70-b56c1ef6072c admin admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.077367 Dec 14 03:12:51.521109 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: [pid: 101846|app: 0|req: 38/77] 10.222.0.43 () {60 vars in 1193 bytes} [Tue Dec 14 03:12:51 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 14 03:13:50.839936 dv-cinder-818037-8-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Dec 14 03:13:50.840793 dv-cinder-818037-8-iscsi devstack@n-api.service[101844]: Tue Dec 14 03:13:50 2021 - graceful shutdown triggered... Dec 14 03:13:50.841288 dv-cinder-818037-8-iscsi devstack@n-api.service[101845]: Gracefully killing worker 1 (pid: 101845)... Dec 14 03:13:50.841748 dv-cinder-818037-8-iscsi devstack@n-api.service[101846]: Gracefully killing worker 2 (pid: 101846)... Dec 14 03:13:51.841039 dv-cinder-818037-8-iscsi devstack@n-api.service[101844]: worker 1 buried after 1 seconds Dec 14 03:13:51.841531 dv-cinder-818037-8-iscsi devstack@n-api.service[101844]: worker 2 buried after 1 seconds Dec 14 03:13:51.841531 dv-cinder-818037-8-iscsi devstack@n-api.service[101844]: goodbye to uWSGI. Dec 14 03:13:51.842567 dv-cinder-818037-8-iscsi systemd[1]: devstack@n-api.service: Succeeded. Dec 14 03:13:51.843150 dv-cinder-818037-8-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Dec 14 03:13:51.846194 dv-cinder-818037-8-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Dec 14 03:13:51.857227 dv-cinder-818037-8-iscsi devstack@n-api.service[116056]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Dec 14 03:13:51.859258 dv-cinder-818037-8-iscsi devstack@n-api.service[116056]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Dec 14 03:13:51 2021] *** Dec 14 03:13:51.859258 dv-cinder-818037-8-iscsi devstack@n-api.service[116056]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Dec 14 03:13:51.859258 dv-cinder-818037-8-iscsi devstack@n-api.service[116056]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Dec 14 03:13:51.859258 dv-cinder-818037-8-iscsi devstack@n-api.service[116056]: nodename: dv-cinder-818037-8-iscsi Dec 14 03:13:51.859258 dv-cinder-818037-8-iscsi devstack@n-api.service[116056]: machine: x86_64 Dec 14 03:13:51.859258 dv-cinder-818037-8-iscsi devstack@n-api.service[116056]: clock source: unix Dec 14 03:13:51.859258 dv-cinder-818037-8-iscsi devstack@n-api.service[116056]: pcre jit disabled Dec 14 03:13:51.859258 dv-cinder-818037-8-iscsi devstack@n-api.service[116056]: detected number of CPU cores: 4 Dec 14 03:13:51.859258 dv-cinder-818037-8-iscsi devstack@n-api.service[116056]: current working directory: / Dec 14 03:13:51.859258 dv-cinder-818037-8-iscsi devstack@n-api.service[116056]: detected binary path: /usr/bin/uwsgi-core Dec 14 03:13:51.859258 dv-cinder-818037-8-iscsi devstack@n-api.service[116056]: your processes number limit is 47680 Dec 14 03:13:51.860231 dv-cinder-818037-8-iscsi devstack@n-api.service[116056]: your memory page size is 4096 bytes Dec 14 03:13:51.860231 dv-cinder-818037-8-iscsi devstack@n-api.service[116056]: detected max file descriptor number: 2048 Dec 14 03:13:51.860231 dv-cinder-818037-8-iscsi devstack@n-api.service[116056]: lock engine: pthread robust mutexes Dec 14 03:13:51.860231 dv-cinder-818037-8-iscsi devstack@n-api.service[116056]: thunder lock: enabled Dec 14 03:13:51.860231 dv-cinder-818037-8-iscsi devstack@n-api.service[116056]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Dec 14 03:13:51.860231 dv-cinder-818037-8-iscsi devstack@n-api.service[116056]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Dec 14 03:13:51.905548 dv-cinder-818037-8-iscsi devstack@n-api.service[116056]: Python main interpreter initialized at 0x561b5c1359c0 Dec 14 03:13:51.905548 dv-cinder-818037-8-iscsi devstack@n-api.service[116056]: python threads support enabled Dec 14 03:13:51.905548 dv-cinder-818037-8-iscsi devstack@n-api.service[116056]: your server socket listen backlog is limited to 100 connections Dec 14 03:13:51.905548 dv-cinder-818037-8-iscsi devstack@n-api.service[116056]: your mercy for graceful operations on workers is 90 seconds Dec 14 03:13:51.905957 dv-cinder-818037-8-iscsi devstack@n-api.service[116056]: mapped 403077 bytes (393 KB) for 2 cores Dec 14 03:13:51.905957 dv-cinder-818037-8-iscsi devstack@n-api.service[116056]: *** Operational MODE: preforking *** Dec 14 03:13:51.906338 dv-cinder-818037-8-iscsi devstack@n-api.service[116056]: *** uWSGI is running in multiple interpreter mode *** Dec 14 03:13:51.906338 dv-cinder-818037-8-iscsi devstack@n-api.service[116056]: spawned uWSGI master process (pid: 116056) Dec 14 03:13:51.906354 dv-cinder-818037-8-iscsi systemd[1]: Started Devstack devstack@n-api.service. Dec 14 03:13:51.906947 dv-cinder-818037-8-iscsi devstack@n-api.service[116056]: spawned uWSGI worker 1 (pid: 116071, cores: 1) Dec 14 03:13:51.908289 dv-cinder-818037-8-iscsi devstack@n-api.service[116056]: spawned uWSGI worker 2 (pid: 116072, cores: 1) Dec 14 03:13:51.908289 dv-cinder-818037-8-iscsi devstack@n-api.service[116056]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Dec 14 03:13:53.814519 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 14 03:13:53.814519 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: from cryptography.utils import int_from_bytes Dec 14 03:13:53.815442 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 14 03:13:53.815442 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: from cryptography.utils import int_from_bytes Dec 14 03:13:53.856304 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 14 03:13:53.856304 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: from cryptography.utils import int_from_bytes Dec 14 03:13:53.857014 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 14 03:13:53.857014 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: from cryptography.utils import int_from_bytes Dec 14 03:13:56.225133 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 14 03:13:56.226275 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 14 03:13:56.226434 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 14 03:13:56.226857 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 14 03:13:56.227144 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 14 03:13:56.227580 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.227914 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.228441 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.228775 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.229117 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.229437 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.229767 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.230104 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.230437 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.230707 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.231033 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.231393 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-818037-8-iscsi {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.231723 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.232037 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.232358 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.232685 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.232999 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.233334 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.233652 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.234174 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.234955 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.235301 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.235623 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.235973 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.236298 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.236618 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.236947 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.237266 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.237598 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.237914 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.238585 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-818037-8-iscsi {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.238910 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.239261 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.239581 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.240008 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.240329 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.240647 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.240976 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.241345 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.241664 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.241999 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.242327 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.242658 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.242987 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.243330 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.243647 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.243961 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.244288 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.244601 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.244910 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.245168 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.245480 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.245808 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.246138 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.246468 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.246725 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.246980 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.247333 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.247666 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.247983 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.248298 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.248613 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.248928 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.249242 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.249556 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.249870 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.250183 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.250506 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.250827 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.251182 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.251497 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.251824 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.252229 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.252485 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.252800 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.253150 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.253479 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.253796 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.254125 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.254453 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.254779 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.255108 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.255425 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.255754 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.256097 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.256410 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.256668 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.257526 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.257902 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.258278 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.258595 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.259163 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.259702 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.260018 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.260335 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.260655 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.260971 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.261290 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.261607 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.261920 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.262238 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.262552 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.262866 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.263223 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.263555 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.263876 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.264191 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.264505 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.264832 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.265208 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.265539 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.265899 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.266245 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.266610 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.266933 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.267283 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.267603 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.267919 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.268246 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.268556 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.268877 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.269309 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.269683 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.270002 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.270348 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.270733 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.271117 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.271421 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.271734 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.272048 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.272358 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.273360 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.273735 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.274109 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.274559 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.274880 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.275018 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 14 03:13:56.275501 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.275640 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 14 03:13:56.275728 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.275810 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 14 03:13:56.276092 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.276197 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 14 03:13:56.276411 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 14 03:13:56.276718 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.276824 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.276921 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.277136 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.277257 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.277470 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.277579 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.277800 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.277948 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.278139 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.278245 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.278459 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.278558 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.278789 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.278884 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.279135 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.279249 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.279460 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.279558 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.279732 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.279828 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.280059 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.280172 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.280394 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-818037-8-iscsi {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.280508 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.280723 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.280813 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.281042 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.281143 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.281361 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.281451 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.281685 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.281780 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.281998 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.282086 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.282323 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.282442 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.282636 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.282735 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.282980 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.283178 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.283332 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.283504 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.283684 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.283821 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.284033 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.284144 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.284354 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.284490 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.284686 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.284825 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.285006 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.285134 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.285336 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.285429 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.285655 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.285763 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.285973 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.286068 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.286294 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.286384 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.286631 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.286767 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-818037-8-iscsi {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.286950 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.287120 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.287307 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.287447 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.287653 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.287772 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.287979 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.288217 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.288312 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.288543 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.288639 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.288864 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.288961 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.289195 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.289300 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.289528 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.289662 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.289837 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.289933 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.290164 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.290262 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.290495 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.290618 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.290809 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.290930 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.291173 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.291293 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.291485 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.291584 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.291800 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.291905 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.292116 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.292240 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.292425 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.292531 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.292742 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.292850 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.293054 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.293162 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.293315 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.293464 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.293639 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.293776 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.293970 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.294074 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.294281 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.294369 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.294607 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.294703 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.294870 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.294967 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.295144 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.295232 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.295470 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.295569 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.295802 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.295895 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.296121 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.296216 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.296439 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.296541 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.296758 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.296859 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.297077 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.297166 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.297390 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.297496 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.297708 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.297804 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.298025 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.298163 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.298342 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.298515 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.298669 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.298757 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.298995 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.299099 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.299350 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.299509 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.299729 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.299994 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.300402 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.300576 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.300820 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.300967 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.301195 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.301341 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.301488 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.301636 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.301785 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.302016 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.302164 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.302315 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.302454 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.302601 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.302754 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.302900 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.303081 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.303228 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.303367 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.304530 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.304530 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.304877 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.304978 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.305076 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.305168 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.305258 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.305342 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.305430 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.305517 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.305606 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.305689 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.305819 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.305819 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.305984 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.305984 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.306140 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.306140 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.306302 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.306397 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.306488 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.306681 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.306780 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.306990 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.307127 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.308217 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.308359 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.308506 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.308595 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.308685 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.308768 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.308768 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.308940 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.309069 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.309166 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.309250 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.309344 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.309473 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.309559 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.309640 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.309849 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.309979 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.310182 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.310282 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.310500 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.310590 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.310819 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.310927 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.311161 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.311276 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.311479 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.311586 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.311790 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.311886 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.312116 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.312213 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.312433 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.312541 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.312748 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.312854 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.313077 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.313175 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.313398 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.313510 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.313712 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.313810 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.314035 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.314131 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.314351 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.314455 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.314666 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.314769 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.314985 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.315135 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.315319 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.315416 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.315637 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.315742 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.315953 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.316069 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.316267 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.316366 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.316583 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.316680 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.316894 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.317000 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.317209 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.317299 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.317523 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.317619 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.317835 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.317937 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.318145 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.318240 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.318457 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.318590 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.318766 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.318875 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.319121 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.319227 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.319979 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.320094 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.320297 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.320394 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.320614 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.320712 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.320929 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.321029 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.321249 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.321349 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 03:13:56.321561 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.321657 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.321873 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.321971 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.322194 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.322307 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.322516 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.322613 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.322833 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.322929 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.323244 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.323337 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.323561 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.323662 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.323884 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.323987 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.324206 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.324302 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.324520 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.324616 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.324832 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.324990 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.325150 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.325243 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.325479 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.325567 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.325796 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.325893 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.326123 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.326219 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.326450 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.326539 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.326764 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.326866 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.327114 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.327220 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.327437 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.327534 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.327753 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.327842 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.328067 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.328155 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.328403 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.328546 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.328733 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.328990 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.329121 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.329353 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.329469 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.329741 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.329864 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.329980 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.330104 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.330319 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.330440 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.330608 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.330724 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.330937 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.331196 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.331315 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.331506 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.331639 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.331748 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.331902 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.332017 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.332231 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.332344 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.332554 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.332668 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.332868 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.332988 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.333219 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.333356 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.333497 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.333814 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.334133 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.334466 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.334781 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.335738 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.336060 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.336373 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.336691 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.337016 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.337605 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.337943 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.338267 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.338593 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.338924 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.339273 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.339522 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.339648 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.339895 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.340018 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.340241 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.340468 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.340584 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.340700 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.340860 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.340974 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.341172 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.341388 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.341531 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.341720 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.341834 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.341947 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.342084 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.342219 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.342394 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.342549 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.342704 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.342905 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.343021 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.343343 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.343514 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.343650 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.343992 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.344229 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.344366 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.344617 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.344760 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.344929 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.345205 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.345355 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.345543 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.345724 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.345862 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.346172 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.346300 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.346482 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.346748 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.346888 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.347104 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.347288 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.347457 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.347742 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.347871 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.348100 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.348238 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.348436 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.348691 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.348819 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.349084 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.349347 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.349478 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.349708 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.349844 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.350017 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.350328 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.350663 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.351077 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.351219 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.351460 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.351608 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.351996 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.352135 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.352268 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.352402 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.352537 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.352819 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.352938 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.353053 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.353282 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.353470 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.353590 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.353706 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.353821 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.354206 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.354381 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.354656 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.354825 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.354969 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.355146 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.355406 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.355565 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.355726 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.355875 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.356022 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.356169 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.356315 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.356454 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.356669 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.356836 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.357230 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.357438 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.357590 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.357746 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.357910 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.358064 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.358211 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.358366 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.358507 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.358654 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.358803 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.358943 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.359124 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.359424 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.359582 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.359793 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.359958 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.360106 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.360253 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.360394 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.360540 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.360801 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.360950 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.361091 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.361229 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.361374 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.361546 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.361787 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.361955 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.362211 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.362367 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.362515 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.362673 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.362821 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.362962 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.363387 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.363550 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.363697 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.363849 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.363990 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.363990 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.364263 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.364419 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.364578 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.364726 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.364922 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.365102 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.365453 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.365622 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.365774 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.365916 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.366065 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.366204 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.366343 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.366510 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.366715 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.366863 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.367032 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.367222 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.367370 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.367546 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.367700 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.367883 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.368028 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.368209 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.368361 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.368548 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.368706 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.368857 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.369080 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.369256 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.369494 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.369641 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.369790 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.369939 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.370078 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.370216 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.370361 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.370513 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.370708 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.370974 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.371185 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.371489 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.371850 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.372121 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.372346 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.372498 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.372646 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.372785 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.372969 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.373126 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.373305 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.373459 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.373631 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.374341 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.374495 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.374645 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.374645 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.374928 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.375114 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.375267 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.375415 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.375639 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.375793 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.375933 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.376080 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.376231 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.376382 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.376523 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.376669 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.376808 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.376954 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.377101 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.377249 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.377249 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.377530 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.377678 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.377816 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.377961 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.378128 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.378269 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.378415 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.378555 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.378695 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.378833 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.378980 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.379184 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.379326 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.379483 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.379697 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.379853 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.380012 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.380152 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.380291 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.380436 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.380574 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.380721 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.380869 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.381122 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.381278 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.381426 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.381573 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.381722 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.382528 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.382691 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.382832 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.382971 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.383146 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.383290 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.383429 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.383566 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.383711 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.383850 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.384003 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.384143 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.384288 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.384426 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.384581 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.384721 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.384868 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.385008 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.385189 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.385336 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.385509 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.385676 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.385897 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.386049 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.386189 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.386327 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.386465 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.386614 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.386767 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.386940 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.387118 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.387311 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.387458 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.387737 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.387882 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.388050 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.388203 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.388395 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.388548 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.388768 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.388921 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.389060 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.389258 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.389465 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.389613 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.389854 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.390007 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.390147 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.390294 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.390493 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.390649 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.390814 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.390969 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.391239 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.391399 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.391549 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.391697 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.391851 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.391997 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.392137 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.392276 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.392415 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.392735 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.392881 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.393020 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.393169 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.393316 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.393456 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.393602 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.393749 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.393887 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.394025 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.394162 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.394307 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.394460 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.394600 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.394777 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.394931 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.395201 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.395524 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.395676 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.395927 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.396082 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.396274 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.396426 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.396605 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.396750 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.396922 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.397067 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.397250 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.398210 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.398379 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.398520 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.398658 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.398828 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.398981 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.399176 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.399318 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.399457 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.399771 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.400001 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.400156 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.400329 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.400486 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.400686 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.400839 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.401005 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.401150 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.401402 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.401556 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.401704 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.401843 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.401989 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.402127 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.402279 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.402427 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.402583 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.402896 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.403096 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.403254 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.403395 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.403540 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.403686 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.403827 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.403973 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.404121 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.404259 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.404403 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.404582 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.404739 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.404909 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.405100 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.405294 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.405441 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.405601 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.405754 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.405951 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.406186 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.406331 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.406483 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.406635 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.406792 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.406941 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.407104 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.407249 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.407387 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.407564 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.407711 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.407907 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.408091 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.408265 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.408418 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.408592 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.408738 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.408910 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.409064 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.409239 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.409383 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.409536 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.409675 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.409850 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.410122 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.410281 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.410462 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.410615 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.410761 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.410900 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.411092 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.411251 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.411417 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.411656 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.411803 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.411950 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.412099 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.412281 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.412435 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.412609 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.412762 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.413073 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.413232 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.413381 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.413521 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.413660 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.413855 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.414002 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.414141 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.414289 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.414429 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.414568 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.414707 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.414844 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.415096 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.415271 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.415413 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.415559 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.415726 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.415879 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.416049 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.416217 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.416435 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.416582 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.416728 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.416876 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.417016 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.417171 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.417325 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.417472 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.417612 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.417751 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.417933 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.418080 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.418257 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.418410 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.418581 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.418727 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.418945 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.419103 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.419248 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.419408 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.419558 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.419711 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.419898 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.420074 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.420307 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.420452 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.420600 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.420747 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.421013 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.421159 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.421334 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.421480 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.421646 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.421894 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.422040 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.422178 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.422326 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.422466 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.422606 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.422767 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.422908 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.423324 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.423474 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.423622 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.423775 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.423924 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.424064 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.424203 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.424341 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.424489 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.424641 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.424790 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.424930 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.425077 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.425216 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.425355 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.425502 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.425659 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.425798 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.425946 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.426093 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.426239 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.426387 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.426619 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.426764 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.426904 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.427109 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.427277 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.427428 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.427578 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.427725 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.427874 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.428030 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.428170 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.428370 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.428512 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.428659 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.428812 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.428961 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.429101 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.429240 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.429449 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.429596 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.429776 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.429929 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.430079 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.430357 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.430512 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.430704 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.430859 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.431008 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.431186 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.431433 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.431576 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.431741 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.431900 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.432135 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.432280 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.432427 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.432567 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.432720 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.432861 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.432999 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.433162 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.433384 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.433642 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.433810 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.434010 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.434161 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.434309 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.434448 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.434593 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.434746 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.434895 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.435088 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.435236 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.435387 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.435536 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.435675 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.435825 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.435971 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.436111 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.436249 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.436397 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.436537 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.436760 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.436906 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.437053 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.437192 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.437344 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.437495 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.437634 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.437817 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.437974 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.438115 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.438262 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.438441 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.438594 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.438742 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.438888 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.439128 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.439312 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.439461 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.439668 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.439813 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.439990 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.440233 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.440401 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.440629 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.440775 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.440922 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.441061 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.441262 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.441413 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.441553 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.441700 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.441840 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.441989 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.442156 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.442398 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.442548 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.442698 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.442845 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.442998 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.443188 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.443328 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.443567 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.443814 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.443960 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.444113 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.444113 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.444894 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.445036 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.445246 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.445387 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.445535 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.445673 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.445821 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.445959 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.446105 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.446251 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.446398 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.446545 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.446695 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.446927 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.447103 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.447257 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.447397 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.447537 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.447693 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.447841 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.447988 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.448140 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.448286 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.448458 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.448611 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.448762 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.448910 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.449065 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.449205 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.449351 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.449490 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.449667 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.449814 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.449963 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.450280 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.450492 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.450658 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.450891 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.451142 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.451308 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.451450 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.451589 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.451735 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.451875 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.451875 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.452149 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.452296 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.452548 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.452548 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.452822 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.452822 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.453121 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.453261 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.453406 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.453570 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.453786 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.454055 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.454201 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.454340 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.454480 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.454705 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.454864 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.455059 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.455263 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.455444 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.455692 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.455838 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.456035 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.456195 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.456375 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.456528 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.456692 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.456844 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.457083 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.457237 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.457389 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.457529 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.457667 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.457864 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.458030 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.458207 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.458354 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.458535 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.458680 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.458850 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.458995 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.459169 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.459314 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.459480 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.459627 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.459782 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.459934 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.460657 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.460933 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.461103 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.461319 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.461644 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.461967 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.462280 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.462625 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.462963 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.463307 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.463556 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.463710 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.463971 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.464243 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.464411 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.464569 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.464726 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.464874 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.465231 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.465393 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.465550 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.465720 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.465876 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.466032 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.466179 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.466326 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.466486 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.466634 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.466922 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.467130 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.467293 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.467448 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.467613 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.467776 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.467929 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.468083 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.468230 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.468376 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.468531 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.468678 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.468826 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.468983 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.469128 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.469318 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.469542 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.469693 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.469857 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.470004 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.470157 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.470316 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.470471 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.470618 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.470780 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.470936 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.471202 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.471367 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.471516 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.471660 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.471814 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.471978 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.472126 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.472280 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.472434 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.472586 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.472836 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.473002 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.473164 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.473312 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.473469 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.473625 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.473772 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.473953 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.474155 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.474413 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.474579 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.474735 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.474883 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.475029 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.475237 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.475386 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.475531 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.475531 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.475851 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.475998 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.476165 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.476313 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.476459 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.476605 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.476758 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.476931 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.477149 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.477301 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.477448 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.477594 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.477747 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.477980 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.478147 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.478302 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.478540 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.478695 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.478869 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.479064 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.479221 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.479369 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.479573 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.479737 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.479894 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.480055 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.480203 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.480364 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.480511 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.480665 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.480821 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.481102 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.481446 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.481785 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.481945 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.482123 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.482286 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.482461 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.482614 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.482916 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.483151 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.483306 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.483469 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.483619 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.483766 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.483913 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.484059 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.484213 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.484361 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.484613 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.484767 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.484923 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.485087 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.485244 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 14 03:13:56.485398 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.485544 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.485873 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.486214 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.486556 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.486907 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.487265 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.487606 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.487946 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.488544 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.488880 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.489217 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.489551 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.489886 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.490220 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.490548 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.490882 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.491446 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.491615 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.492166 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.492512 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.492845 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.493177 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.493501 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.493831 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.494162 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.494496 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.494824 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.495173 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.495497 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.495840 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.496178 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.496517 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.496869 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.497202 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.497533 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.497863 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.498190 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.498564 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.498906 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.499235 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.499564 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.499891 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.500219 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.500544 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.500871 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.501199 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.501661 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.501884 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.502145 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.502472 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.505953 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.505953 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.505953 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.505953 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.505953 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.505953 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.505953 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.505953 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.508136 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.508136 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.508136 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.510267 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.510656 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.511009 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.511392 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.511949 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_db.sqlalchemy.engines [None req-9af78f9f-dd88-4338-a41b-160d7c27ca9b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116072) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 14 03:13:56.512126 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.512275 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.513561 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.513924 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.514260 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.514614 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.516027 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.516027 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.516027 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.516027 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.516601 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.516991 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.517303 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.517648 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.518062 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.518308 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.518624 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.518956 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.519309 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.519625 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.519952 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.520274 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.520584 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.520900 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.521222 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.521541 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.522146 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.522146 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.522502 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.523525 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.523844 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.524161 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.524478 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.524802 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.525117 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.525431 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.525748 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.526059 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.526381 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.526692 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.527014 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.527349 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.527670 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.527987 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.528304 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.528616 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.528949 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.529264 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.529577 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.529905 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.530225 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.530554 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.530874 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.531222 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.531582 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.532698 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.532698 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.533012 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.533173 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.533604 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.533961 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.534281 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.534597 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.534914 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.535290 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.535610 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.535934 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.536717 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.536717 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.537142 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.537297 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.537480 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.537800 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.538302 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.538470 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.538868 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.539621 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.539621 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.539958 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.540177 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.540495 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.540813 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.541133 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.541452 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.541779 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.542118 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.542440 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.542938 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.543210 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.543647 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.543943 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.544216 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.544534 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.544862 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.545194 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.545514 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.545842 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.546161 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.546510 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.546842 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.547292 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.547560 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.547875 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.548187 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.548503 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.548818 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.549154 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.549496 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.549821 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.550152 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.550471 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.550804 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.551211 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.551465 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.551850 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.552210 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.552529 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.552867 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.553182 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.553499 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.553866 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.554189 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.554507 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.554828 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.555190 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.555542 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.555843 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.556175 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.556501 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.556832 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.557158 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.557478 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.557812 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.558132 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.558456 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.558776 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.559124 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.559453 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.559776 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.560108 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.560441 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.560776 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.561110 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.561463 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.561785 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.562136 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.562471 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.562790 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.563174 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.563445 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 03:13:56.563693 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 14 03:13:56.579461 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.context [None req-9af78f9f-dd88-4338-a41b-160d7c27ca9b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8f4f9783-5b67-4c46-a873-d02b5f040c2e(cell1) {{(pid=116072) load_cells /opt/stack/nova/nova/context.py:464}} Dec 14 03:13:56.583882 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9af78f9f-dd88-4338-a41b-160d7c27ca9b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:13:56.586176 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9af78f9f-dd88-4338-a41b-160d7c27ca9b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:13:56.587223 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9af78f9f-dd88-4338-a41b-160d7c27ca9b None None] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:13:56.587406 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_db.sqlalchemy.engines [None req-4de768b3-257a-4b21-8605-327b7f41cebc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116071) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 14 03:13:56.589043 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9af78f9f-dd88-4338-a41b-160d7c27ca9b None None] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:13:56.601615 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_db.sqlalchemy.engines [None req-9af78f9f-dd88-4338-a41b-160d7c27ca9b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116072) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 14 03:13:56.602467 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_db.sqlalchemy.engines [None req-9af78f9f-dd88-4338-a41b-160d7c27ca9b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116072) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 14 03:13:56.653999 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.context [None req-4de768b3-257a-4b21-8605-327b7f41cebc None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8f4f9783-5b67-4c46-a873-d02b5f040c2e(cell1) {{(pid=116071) load_cells /opt/stack/nova/nova/context.py:464}} Dec 14 03:13:56.658380 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-4de768b3-257a-4b21-8605-327b7f41cebc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:13:56.660030 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-4de768b3-257a-4b21-8605-327b7f41cebc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:13:56.660785 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-4de768b3-257a-4b21-8605-327b7f41cebc None None] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:13:56.662717 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-4de768b3-257a-4b21-8605-327b7f41cebc None None] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:13:56.675236 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_db.sqlalchemy.engines [None req-4de768b3-257a-4b21-8605-327b7f41cebc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116071) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 14 03:13:56.681236 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_db.sqlalchemy.engines [None req-4de768b3-257a-4b21-8605-327b7f41cebc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116071) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 14 03:13:56.763677 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_db.sqlalchemy.engines [None req-9af78f9f-dd88-4338-a41b-160d7c27ca9b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116072) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 14 03:13:56.837528 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_db.sqlalchemy.engines [None req-4de768b3-257a-4b21-8605-327b7f41cebc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116071) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 14 03:13:57.084997 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: WARNING keystonemiddleware.auth_token [None req-9af78f9f-dd88-4338-a41b-160d7c27ca9b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 14 03:13:57.092285 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: WARNING keystonemiddleware.auth_token [None req-9af78f9f-dd88-4338-a41b-160d7c27ca9b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 14 03:13:57.160297 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: WARNING keystonemiddleware.auth_token [None req-4de768b3-257a-4b21-8605-327b7f41cebc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 14 03:13:57.167621 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: WARNING keystonemiddleware.auth_token [None req-4de768b3-257a-4b21-8605-327b7f41cebc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 14 03:13:57.433015 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: WARNING keystonemiddleware.auth_token [None req-9af78f9f-dd88-4338-a41b-160d7c27ca9b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 14 03:13:57.438141 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: WARNING keystonemiddleware.auth_token [None req-9af78f9f-dd88-4338-a41b-160d7c27ca9b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 14 03:13:57.443505 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561b5c1359c0 pid: 116072 (default app) Dec 14 03:13:57.507339 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: WARNING keystonemiddleware.auth_token [None req-4de768b3-257a-4b21-8605-327b7f41cebc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 14 03:13:57.513077 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: WARNING keystonemiddleware.auth_token [None req-4de768b3-257a-4b21-8605-327b7f41cebc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 14 03:13:57.518420 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561b5c1359c0 pid: 116071 (default app) Dec 14 03:14:30.382346 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-d6846e8a-3b51-42e7-89e3-0fffd1d5e665 tempest-VolumesGetTestJSON-582884179 tempest-VolumesGetTestJSON-582884179-project] Action: 'create', calling method: .version_select at 0x7fa509698ee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1467189932", "metadata": {"Type": "work"}}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:14:32.215945 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-d6846e8a-3b51-42e7-89e3-0fffd1d5e665 tempest-VolumesGetTestJSON-582884179 tempest-VolumesGetTestJSON-582884179-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 2.863177 Dec 14 03:14:32.216842 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 1/1] 10.222.0.43 () {60 vars in 1155 bytes} [Tue Dec 14 03:14:29 2021] POST /compute/v2.1/os-volumes => generated 353 bytes in 2866 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Dec 14 03:14:32.655507 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-512b1d8d-67c2-44e3-9ca6-b8a751344071 tempest-VolumesGetTestJSON-582884179 tempest-VolumesGetTestJSON-582884179-project] Calling method '.version_select at 0x7fa5096f3af0>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:14:33.365647 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-512b1d8d-67c2-44e3-9ca6-b8a751344071 tempest-VolumesGetTestJSON-582884179 tempest-VolumesGetTestJSON-582884179-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/0894ea6e-d2cf-4a8d-ab1c-61797a209e14" status: 200 len: 353 microversion: 2.1 time: 1.139401 Dec 14 03:14:33.366672 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 1/2] 10.222.0.43 () {58 vars in 1244 bytes} [Tue Dec 14 03:14:32 2021] GET /compute/v2.1/os-volumes/0894ea6e-d2cf-4a8d-ab1c-61797a209e14 => generated 353 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:14:33.415609 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-5990991d-3ffe-4534-a53d-7f5cea8a6da8 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1911513337", "imageRef": "4fff76a9-6620-4bda-b1ec-2cd3719c946a", "flavorRef": "452", "networks": [{"uuid": "adc7b7f7-be75-4e68-a215-6654c2c27cac"}]}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:14:33.545732 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.network.neutron [None req-5990991d-3ffe-4534-a53d-7f5cea8a6da8 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] validate_networks() for [('adc7b7f7-be75-4e68-a215-6654c2c27cac', None, None, None, None, None)] {{(pid=116072) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 14 03:14:34.378291 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-e234b8e9-9345-4e76-b5f5-d90909ed1604 tempest-VolumesGetTestJSON-582884179 tempest-VolumesGetTestJSON-582884179-project] Calling method '.version_select at 0x7fa5095bb9d0>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:14:34.468039 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-e234b8e9-9345-4e76-b5f5-d90909ed1604 tempest-VolumesGetTestJSON-582884179 tempest-VolumesGetTestJSON-582884179-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/0894ea6e-d2cf-4a8d-ab1c-61797a209e14" status: 200 len: 354 microversion: 2.1 time: 0.093941 Dec 14 03:14:34.469082 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 2/3] 10.222.0.43 () {58 vars in 1244 bytes} [Tue Dec 14 03:14:34 2021] GET /compute/v2.1/os-volumes/0894ea6e-d2cf-4a8d-ab1c-61797a209e14 => generated 354 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:14:34.481061 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-1462ca3d-c538-467c-a9e0-070a78beee1d tempest-VolumesTestJSON-552524929 tempest-VolumesTestJSON-552524929-project] Calling method '.version_select at 0x7fa509579280>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:14:34.584953 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-1462ca3d-c538-467c-a9e0-070a78beee1d tempest-VolumesTestJSON-552524929 tempest-VolumesTestJSON-552524929-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/dd12accc-f94c-4c21-b310-93e6d7b47021" status: 200 len: 351 microversion: 2.1 time: 0.113669 Dec 14 03:14:34.585568 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 3/4] 10.222.0.43 () {58 vars in 1244 bytes} [Tue Dec 14 03:14:34 2021] GET /compute/v2.1/os-volumes/dd12accc-f94c-4c21-b310-93e6d7b47021 => generated 351 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:14:34.599352 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-1888828f-e2ee-4408-a11b-b54f3c2159d4 tempest-VolumesGetTestJSON-582884179 tempest-VolumesGetTestJSON-582884179-project] Calling method '.version_select at 0x7fa5095bbee0>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:14:34.815709 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-1888828f-e2ee-4408-a11b-b54f3c2159d4 tempest-VolumesGetTestJSON-582884179 tempest-VolumesGetTestJSON-582884179-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/0894ea6e-d2cf-4a8d-ab1c-61797a209e14" status: 200 len: 354 microversion: 2.1 time: 0.220104 Dec 14 03:14:34.816906 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 4/5] 10.222.0.43 () {58 vars in 1244 bytes} [Tue Dec 14 03:14:34 2021] GET /compute/v2.1/os-volumes/0894ea6e-d2cf-4a8d-ab1c-61797a209e14 => generated 354 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:14:34.834714 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-988dfe26-d5b6-4db0-98e6-e9a2b0b777d4 tempest-VolumesGetTestJSON-582884179 tempest-VolumesGetTestJSON-582884179-project] Calling method '.version_select at 0x7fa509579820>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:14:34.897039 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-5990991d-3ffe-4534-a53d-7f5cea8a6da8 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Flavor limits 0:0:0 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 14 03:14:34.898649 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-5990991d-3ffe-4534-a53d-7f5cea8a6da8 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Image limits 0:0:0 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 14 03:14:34.899591 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-5990991d-3ffe-4534-a53d-7f5cea8a6da8 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Flavor pref 0:0:0 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 14 03:14:34.900501 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-5990991d-3ffe-4534-a53d-7f5cea8a6da8 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Image pref 0:0:0 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 14 03:14:34.901034 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-5990991d-3ffe-4534-a53d-7f5cea8a6da8 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 14 03:14:34.938716 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5990991d-3ffe-4534-a53d-7f5cea8a6da8 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:14:34.942018 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5990991d-3ffe-4534-a53d-7f5cea8a6da8 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:14:34.943022 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5990991d-3ffe-4534-a53d-7f5cea8a6da8 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:14:34.943517 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5990991d-3ffe-4534-a53d-7f5cea8a6da8 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:14:35.045715 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.quota [None req-5990991d-3ffe-4534-a53d-7f5cea8a6da8 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Getting quotas for project 7efcbf12d6654bc68690363892415b77. Resources: {'cores', 'instances', 'ram'} {{(pid=116072) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 03:14:35.077118 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.quota [None req-5990991d-3ffe-4534-a53d-7f5cea8a6da8 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Getting quotas for user 63a8e0684f10464394e4f935d687cc48 and project 7efcbf12d6654bc68690363892415b77. Resources: {'cores', 'instances', 'ram'} {{(pid=116072) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 03:14:35.119726 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-5990991d-3ffe-4534-a53d-7f5cea8a6da8 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Going to run 1 instances... {{(pid=116072) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 14 03:14:35.127133 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-5990991d-3ffe-4534-a53d-7f5cea8a6da8 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] [instance: d9988bfe-afac-40fa-ad73-2db57dadf545] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4fff76a9-6620-4bda-b1ec-2cd3719c946a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 14 03:14:35.141390 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-988dfe26-d5b6-4db0-98e6-e9a2b0b777d4 tempest-VolumesGetTestJSON-582884179 tempest-VolumesGetTestJSON-582884179-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/0894ea6e-d2cf-4a8d-ab1c-61797a209e14" status: 202 len: 0 microversion: 2.1 time: 0.310928 Dec 14 03:14:35.142264 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 5/6] 10.222.0.43 () {58 vars in 1247 bytes} [Tue Dec 14 03:14:34 2021] DELETE /compute/v2.1/os-volumes/0894ea6e-d2cf-4a8d-ab1c-61797a209e14 => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 14 03:14:35.150672 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-6b255580-ec81-487d-97ad-c69732bd1c96 tempest-VolumesGetTestJSON-582884179 tempest-VolumesGetTestJSON-582884179-project] Calling method '.version_select at 0x7fa509579040>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:14:35.261532 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-6b255580-ec81-487d-97ad-c69732bd1c96 tempest-VolumesGetTestJSON-582884179 tempest-VolumesGetTestJSON-582884179-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/0894ea6e-d2cf-4a8d-ab1c-61797a209e14" status: 200 len: 353 microversion: 2.1 time: 0.115096 Dec 14 03:14:35.262356 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 6/7] 10.222.0.43 () {58 vars in 1244 bytes} [Tue Dec 14 03:14:35 2021] GET /compute/v2.1/os-volumes/0894ea6e-d2cf-4a8d-ab1c-61797a209e14 => generated 353 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 14 03:14:35.354090 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-5990991d-3ffe-4534-a53d-7f5cea8a6da8 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.014161 Dec 14 03:14:35.356701 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 2/8] 10.222.0.43 () {60 vars in 1146 bytes} [Tue Dec 14 03:14:33 2021] POST /compute/v2.1/servers => generated 380 bytes in 2031 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 14 03:14:35.366954 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-f0bd755c-7cc9-42f7-980a-9bc08d1fa53c tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:14:35.367791 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-f0bd755c-7cc9-42f7-980a-9bc08d1fa53c tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] [instance: d9988bfe-afac-40fa-ad73-2db57dadf545] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:14:35.622344 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-f0bd755c-7cc9-42f7-980a-9bc08d1fa53c tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a8e0684f10464394e4f935d687cc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efcbf12d6654bc68690363892415b77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:14:35.655882 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-f0bd755c-7cc9-42f7-980a-9bc08d1fa53c tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.43 "GET /compute/v2.1/servers/d9988bfe-afac-40fa-ad73-2db57dadf545" status: 200 len: 1215 microversion: 2.1 time: 0.292592 Dec 14 03:14:35.656396 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 7/9] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:14:35 2021] GET /compute/v2.1/servers/d9988bfe-afac-40fa-ad73-2db57dadf545 => generated 1215 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:14:36.274378 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-6927f603-d0f3-40f6-abb2-ef6483843b8c tempest-VolumesGetTestJSON-582884179 tempest-VolumesGetTestJSON-582884179-project] Calling method '.version_select at 0x7fa509482790>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:14:36.296190 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-7e4dc892-6a37-44b6-ad6f-07170f82731f tempest-VolumesTestJSON-552524929 tempest-VolumesTestJSON-552524929-project] Calling method '.version_select at 0x7fa5095790d0>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:14:36.354384 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.wsgi [None req-6927f603-d0f3-40f6-abb2-ef6483843b8c tempest-VolumesGetTestJSON-582884179 tempest-VolumesGetTestJSON-582884179-project] HTTP exception thrown: Volume 0894ea6e-d2cf-4a8d-ab1c-61797a209e14 could not be found. Dec 14 03:14:36.355030 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-6927f603-d0f3-40f6-abb2-ef6483843b8c tempest-VolumesGetTestJSON-582884179 tempest-VolumesGetTestJSON-582884179-project] Returning 404 to user: Volume 0894ea6e-d2cf-4a8d-ab1c-61797a209e14 could not be found. {{(pid=116072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 03:14:36.356612 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-6927f603-d0f3-40f6-abb2-ef6483843b8c tempest-VolumesGetTestJSON-582884179 tempest-VolumesGetTestJSON-582884179-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/0894ea6e-d2cf-4a8d-ab1c-61797a209e14" status: 404 len: 109 microversion: 2.1 time: 0.086104 Dec 14 03:14:36.356612 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 3/10] 10.222.0.43 () {58 vars in 1244 bytes} [Tue Dec 14 03:14:36 2021] GET /compute/v2.1/os-volumes/0894ea6e-d2cf-4a8d-ab1c-61797a209e14 => generated 109 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 14 03:14:36.459989 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-7e4dc892-6a37-44b6-ad6f-07170f82731f tempest-VolumesTestJSON-552524929 tempest-VolumesTestJSON-552524929-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/66c08830-5a8b-4c0c-a70d-3b9dbb5885f9" status: 200 len: 351 microversion: 2.1 time: 0.167616 Dec 14 03:14:36.461533 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 8/11] 10.222.0.43 () {58 vars in 1244 bytes} [Tue Dec 14 03:14:36 2021] GET /compute/v2.1/os-volumes/66c08830-5a8b-4c0c-a70d-3b9dbb5885f9 => generated 351 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:14:36.673012 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-f6c28f85-8d95-4f6e-b684-8955fdb2c062 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:14:36.673735 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-f6c28f85-8d95-4f6e-b684-8955fdb2c062 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] [instance: d9988bfe-afac-40fa-ad73-2db57dadf545] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:14:36.984111 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-f6c28f85-8d95-4f6e-b684-8955fdb2c062 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a8e0684f10464394e4f935d687cc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efcbf12d6654bc68690363892415b77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:14:37.030732 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-f6c28f85-8d95-4f6e-b684-8955fdb2c062 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.43 "GET /compute/v2.1/servers/d9988bfe-afac-40fa-ad73-2db57dadf545" status: 200 len: 1215 microversion: 2.1 time: 0.361253 Dec 14 03:14:37.043241 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 4/12] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:14:36 2021] GET /compute/v2.1/servers/d9988bfe-afac-40fa-ad73-2db57dadf545 => generated 1215 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:14:38.061363 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-504bf5d7-ad31-45c9-add9-4ad96b5dd464 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:14:38.062646 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-504bf5d7-ad31-45c9-add9-4ad96b5dd464 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] [instance: d9988bfe-afac-40fa-ad73-2db57dadf545] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:14:38.072643 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-504bf5d7-ad31-45c9-add9-4ad96b5dd464 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:14:38.076259 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-504bf5d7-ad31-45c9-add9-4ad96b5dd464 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:14:38.079909 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-504bf5d7-ad31-45c9-add9-4ad96b5dd464 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:14:38.081041 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-504bf5d7-ad31-45c9-add9-4ad96b5dd464 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:14:38.239485 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-cb01a84a-54a7-4642-b2d9-16f5be99d6c8 tempest-VolumesTestJSON-552524929 tempest-VolumesTestJSON-552524929-project] Calling method '.version_select at 0x7fa508c3d1f0>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:14:38.351300 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-cb01a84a-54a7-4642-b2d9-16f5be99d6c8 tempest-VolumesTestJSON-552524929 tempest-VolumesTestJSON-552524929-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/8e222d1d-b12c-47e7-b9ec-566e5f02b5a1" status: 200 len: 351 microversion: 2.1 time: 0.115909 Dec 14 03:14:38.352441 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 5/13] 10.222.0.43 () {58 vars in 1244 bytes} [Tue Dec 14 03:14:38 2021] GET /compute/v2.1/os-volumes/8e222d1d-b12c-47e7-b9ec-566e5f02b5a1 => generated 351 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:14:38.364203 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-f3c797ef-9db2-44ae-a2f2-3991a57091a4 tempest-VolumesTestJSON-552524929 tempest-VolumesTestJSON-552524929-project] Calling method '.version_select at 0x7fa5083d4430>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:14:38.573245 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-f3c797ef-9db2-44ae-a2f2-3991a57091a4 tempest-VolumesTestJSON-552524929 tempest-VolumesTestJSON-552524929-project] 10.222.0.43 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.213416 Dec 14 03:14:38.574226 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 6/14] 10.222.0.43 () {58 vars in 1133 bytes} [Tue Dec 14 03:14:38 2021] GET /compute/v2.1/os-volumes => generated 1036 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:14:38.587279 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-41e686d7-91b4-4dd9-832b-864579be3e60 tempest-VolumesTestJSON-552524929 tempest-VolumesTestJSON-552524929-project] Calling method '.version_select at 0x7fa508c3d3a0>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:14:38.633964 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-504bf5d7-ad31-45c9-add9-4ad96b5dd464 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a8e0684f10464394e4f935d687cc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efcbf12d6654bc68690363892415b77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:14:38.679660 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-504bf5d7-ad31-45c9-add9-4ad96b5dd464 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.43 "GET /compute/v2.1/servers/d9988bfe-afac-40fa-ad73-2db57dadf545" status: 200 len: 1219 microversion: 2.1 time: 0.626526 Dec 14 03:14:38.695141 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 9/15] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:14:38 2021] GET /compute/v2.1/servers/d9988bfe-afac-40fa-ad73-2db57dadf545 => generated 1219 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 03:14:39.070681 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-41e686d7-91b4-4dd9-832b-864579be3e60 tempest-VolumesTestJSON-552524929 tempest-VolumesTestJSON-552524929-project] 10.222.0.43 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.487586 Dec 14 03:14:39.071616 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 7/16] 10.222.0.43 () {58 vars in 1148 bytes} [Tue Dec 14 03:14:38 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:14:39.085237 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-2fda7e5e-88b0-4e2d-ac00-1bf5434e3ea7 tempest-VolumesTestJSON-552524929 tempest-VolumesTestJSON-552524929-project] Calling method '.version_select at 0x7fa509452790>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:14:39.411995 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-2fda7e5e-88b0-4e2d-ac00-1bf5434e3ea7 tempest-VolumesTestJSON-552524929 tempest-VolumesTestJSON-552524929-project] 10.222.0.43 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.331618 Dec 14 03:14:39.418745 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 10/17] 10.222.0.43 () {58 vars in 1133 bytes} [Tue Dec 14 03:14:39 2021] GET /compute/v2.1/os-volumes => generated 1036 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:14:39.424445 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-1a0805d3-546e-4708-8053-4d2aa057695c tempest-VolumesTestJSON-552524929 tempest-VolumesTestJSON-552524929-project] Calling method '.version_select at 0x7fa5083d4280>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:14:39.580478 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-1a0805d3-546e-4708-8053-4d2aa057695c tempest-VolumesTestJSON-552524929 tempest-VolumesTestJSON-552524929-project] 10.222.0.43 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.160688 Dec 14 03:14:39.582075 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 8/18] 10.222.0.43 () {58 vars in 1166 bytes} [Tue Dec 14 03:14:39 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:14:39.594010 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-2a6c1bfa-dc7c-43aa-95a0-d5b6135bdb71 tempest-VolumesTestJSON-552524929 tempest-VolumesTestJSON-552524929-project] Calling method '.version_select at 0x7fa509ef8700>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:14:39.697418 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-f727ab7f-4d27-4c20-8795-2c91dc848004 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:14:39.698476 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-f727ab7f-4d27-4c20-8795-2c91dc848004 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] [instance: d9988bfe-afac-40fa-ad73-2db57dadf545] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:14:39.712261 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f727ab7f-4d27-4c20-8795-2c91dc848004 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:14:39.712975 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f727ab7f-4d27-4c20-8795-2c91dc848004 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:14:39.714009 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f727ab7f-4d27-4c20-8795-2c91dc848004 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:14:39.714663 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f727ab7f-4d27-4c20-8795-2c91dc848004 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:14:39.800375 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-2a6c1bfa-dc7c-43aa-95a0-d5b6135bdb71 tempest-VolumesTestJSON-552524929 tempest-VolumesTestJSON-552524929-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.209710 Dec 14 03:14:39.808832 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 11/19] 10.222.0.43 () {58 vars in 1169 bytes} [Tue Dec 14 03:14:39 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:14:39.813754 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-db87103f-b032-485a-83bd-7071d943764a tempest-VolumesTestJSON-552524929 tempest-VolumesTestJSON-552524929-project] Calling method '.version_select at 0x7fa5094bbf70>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:14:40.049327 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-db87103f-b032-485a-83bd-7071d943764a tempest-VolumesTestJSON-552524929 tempest-VolumesTestJSON-552524929-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.239175 Dec 14 03:14:40.049902 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 12/20] 10.222.0.43 () {58 vars in 1154 bytes} [Tue Dec 14 03:14:39 2021] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:14:40.065068 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-80505690-d7d1-4785-8353-45cb4896f199 tempest-VolumesTestJSON-552524929 tempest-VolumesTestJSON-552524929-project] Calling method '.version_select at 0x7fa5095444c0>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:14:40.276542 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-80505690-d7d1-4785-8353-45cb4896f199 tempest-VolumesTestJSON-552524929 tempest-VolumesTestJSON-552524929-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.215445 Dec 14 03:14:40.277172 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 13/21] 10.222.0.43 () {58 vars in 1187 bytes} [Tue Dec 14 03:14:40 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 14 03:14:40.289243 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-101eaa89-bcb8-48ba-a3b7-43e5aa8a1053 tempest-VolumesTestJSON-552524929 tempest-VolumesTestJSON-552524929-project] Calling method '.version_select at 0x7fa509542ee0>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:14:40.332676 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-f727ab7f-4d27-4c20-8795-2c91dc848004 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a8e0684f10464394e4f935d687cc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efcbf12d6654bc68690363892415b77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:14:40.362644 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-f727ab7f-4d27-4c20-8795-2c91dc848004 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.43 "GET /compute/v2.1/servers/d9988bfe-afac-40fa-ad73-2db57dadf545" status: 200 len: 1273 microversion: 2.1 time: 0.665661 Dec 14 03:14:40.363562 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 9/22] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:14:39 2021] GET /compute/v2.1/servers/d9988bfe-afac-40fa-ad73-2db57dadf545 => generated 1273 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 03:14:40.487571 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-101eaa89-bcb8-48ba-a3b7-43e5aa8a1053 tempest-VolumesTestJSON-552524929 tempest-VolumesTestJSON-552524929-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.202298 Dec 14 03:14:40.488447 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 14/23] 10.222.0.43 () {58 vars in 1154 bytes} [Tue Dec 14 03:14:40 2021] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 03:14:41.380798 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-3cabec72-acf7-4311-a4eb-11ae44979463 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:14:41.382378 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-3cabec72-acf7-4311-a4eb-11ae44979463 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] [instance: d9988bfe-afac-40fa-ad73-2db57dadf545] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:14:41.390181 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3cabec72-acf7-4311-a4eb-11ae44979463 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:14:41.399354 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3cabec72-acf7-4311-a4eb-11ae44979463 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:14:41.401359 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3cabec72-acf7-4311-a4eb-11ae44979463 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:14:41.403217 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3cabec72-acf7-4311-a4eb-11ae44979463 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:14:41.876387 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-3cabec72-acf7-4311-a4eb-11ae44979463 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a8e0684f10464394e4f935d687cc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efcbf12d6654bc68690363892415b77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:14:41.896317 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-3cabec72-acf7-4311-a4eb-11ae44979463 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.43 "GET /compute/v2.1/servers/d9988bfe-afac-40fa-ad73-2db57dadf545" status: 200 len: 1273 microversion: 2.1 time: 0.519534 Dec 14 03:14:41.909134 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 10/24] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:14:41 2021] GET /compute/v2.1/servers/d9988bfe-afac-40fa-ad73-2db57dadf545 => generated 1273 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:14:42.926694 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-b17e5167-271c-4bb0-89fe-5d65dff50eef tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:14:42.927400 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-b17e5167-271c-4bb0-89fe-5d65dff50eef tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] [instance: d9988bfe-afac-40fa-ad73-2db57dadf545] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:14:42.946193 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b17e5167-271c-4bb0-89fe-5d65dff50eef tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:14:42.946731 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b17e5167-271c-4bb0-89fe-5d65dff50eef tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:14:42.947610 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b17e5167-271c-4bb0-89fe-5d65dff50eef tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:14:42.948122 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b17e5167-271c-4bb0-89fe-5d65dff50eef tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:14:43.956104 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-b17e5167-271c-4bb0-89fe-5d65dff50eef tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a8e0684f10464394e4f935d687cc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efcbf12d6654bc68690363892415b77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:14:43.966811 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-b17e5167-271c-4bb0-89fe-5d65dff50eef tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.43 "GET /compute/v2.1/servers/d9988bfe-afac-40fa-ad73-2db57dadf545" status: 200 len: 1315 microversion: 2.1 time: 1.051768 Dec 14 03:14:43.966811 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 15/25] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:14:42 2021] GET /compute/v2.1/servers/d9988bfe-afac-40fa-ad73-2db57dadf545 => generated 1315 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:14:44.982552 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-16adb56e-cc90-4873-a800-bd502cfaca1e tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:14:44.983506 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-16adb56e-cc90-4873-a800-bd502cfaca1e tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] [instance: d9988bfe-afac-40fa-ad73-2db57dadf545] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:14:44.996312 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-16adb56e-cc90-4873-a800-bd502cfaca1e tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:14:44.996762 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-16adb56e-cc90-4873-a800-bd502cfaca1e tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:14:45.001663 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-16adb56e-cc90-4873-a800-bd502cfaca1e tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:14:45.002209 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-16adb56e-cc90-4873-a800-bd502cfaca1e tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:14:46.133731 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-16adb56e-cc90-4873-a800-bd502cfaca1e tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a8e0684f10464394e4f935d687cc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efcbf12d6654bc68690363892415b77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:14:46.163118 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-16adb56e-cc90-4873-a800-bd502cfaca1e tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.43 "GET /compute/v2.1/servers/d9988bfe-afac-40fa-ad73-2db57dadf545" status: 200 len: 1315 microversion: 2.1 time: 1.181854 Dec 14 03:14:46.167743 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 11/26] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:14:44 2021] GET /compute/v2.1/servers/d9988bfe-afac-40fa-ad73-2db57dadf545 => generated 1315 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:14:46.966183 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-adca4b5a-30a6-4150-b9ea-369e9fb13fed tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1194619394", "imageRef": "4fff76a9-6620-4bda-b1ec-2cd3719c946a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b4af40aa-6be1-48c2-866d-05aa1bdec9d3"}]}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:14:47.143897 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.network.neutron [None req-adca4b5a-30a6-4150-b9ea-369e9fb13fed tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] validate_networks() for [('b4af40aa-6be1-48c2-866d-05aa1bdec9d3', None, None, None, None, None)] {{(pid=116071) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 14 03:14:47.184451 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-9766fc2f-4e99-4cdd-95f2-3c6653f5eb5a tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:14:47.185762 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-9766fc2f-4e99-4cdd-95f2-3c6653f5eb5a tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] [instance: d9988bfe-afac-40fa-ad73-2db57dadf545] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:14:47.194691 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9766fc2f-4e99-4cdd-95f2-3c6653f5eb5a tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:14:47.197841 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9766fc2f-4e99-4cdd-95f2-3c6653f5eb5a tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:14:47.198887 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9766fc2f-4e99-4cdd-95f2-3c6653f5eb5a tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:14:47.201607 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9766fc2f-4e99-4cdd-95f2-3c6653f5eb5a tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:14:48.000300 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-9766fc2f-4e99-4cdd-95f2-3c6653f5eb5a tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a8e0684f10464394e4f935d687cc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efcbf12d6654bc68690363892415b77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:14:48.008841 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-9766fc2f-4e99-4cdd-95f2-3c6653f5eb5a tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.43 "GET /compute/v2.1/servers/d9988bfe-afac-40fa-ad73-2db57dadf545" status: 200 len: 1315 microversion: 2.1 time: 0.828362 Dec 14 03:14:48.017976 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 12/27] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:14:47 2021] GET /compute/v2.1/servers/d9988bfe-afac-40fa-ad73-2db57dadf545 => generated 1315 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:14:49.025836 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-2b1ec690-8276-4045-a2f3-9a7803563643 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:14:49.026755 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-2b1ec690-8276-4045-a2f3-9a7803563643 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] [instance: d9988bfe-afac-40fa-ad73-2db57dadf545] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:14:49.046916 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2b1ec690-8276-4045-a2f3-9a7803563643 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:14:49.050590 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2b1ec690-8276-4045-a2f3-9a7803563643 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:14:49.051622 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2b1ec690-8276-4045-a2f3-9a7803563643 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:14:49.054980 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2b1ec690-8276-4045-a2f3-9a7803563643 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:14:49.213574 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.virt.hardware [None req-adca4b5a-30a6-4150-b9ea-369e9fb13fed tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Flavor limits 0:0:0 {{(pid=116071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 14 03:14:49.214081 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.virt.hardware [None req-adca4b5a-30a6-4150-b9ea-369e9fb13fed tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Image limits 0:0:0 {{(pid=116071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 14 03:14:49.214555 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.virt.hardware [None req-adca4b5a-30a6-4150-b9ea-369e9fb13fed tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Flavor pref 0:0:0 {{(pid=116071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 14 03:14:49.214873 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.virt.hardware [None req-adca4b5a-30a6-4150-b9ea-369e9fb13fed tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Image pref 0:0:0 {{(pid=116071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 14 03:14:49.215502 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.virt.hardware [None req-adca4b5a-30a6-4150-b9ea-369e9fb13fed tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 14 03:14:49.272815 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-adca4b5a-30a6-4150-b9ea-369e9fb13fed tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:14:49.273276 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-adca4b5a-30a6-4150-b9ea-369e9fb13fed tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:14:49.274104 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-adca4b5a-30a6-4150-b9ea-369e9fb13fed tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:14:49.274728 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-adca4b5a-30a6-4150-b9ea-369e9fb13fed tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:14:49.366800 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.quota [None req-adca4b5a-30a6-4150-b9ea-369e9fb13fed tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Getting quotas for project bb4be946dd9b4b2080fb3b398521624e. Resources: {'cores', 'instances', 'ram'} {{(pid=116071) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 03:14:49.391976 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.quota [None req-adca4b5a-30a6-4150-b9ea-369e9fb13fed tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Getting quotas for user 57a541b5dc154896bced57a79750a3c4 and project bb4be946dd9b4b2080fb3b398521624e. Resources: {'cores', 'instances', 'ram'} {{(pid=116071) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 03:14:49.433681 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-adca4b5a-30a6-4150-b9ea-369e9fb13fed tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Going to run 1 instances... {{(pid=116071) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 14 03:14:49.436651 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-adca4b5a-30a6-4150-b9ea-369e9fb13fed tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: 4687b559-c95a-4b82-a076-a7468c10ebef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4fff76a9-6620-4bda-b1ec-2cd3719c946a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 14 03:14:49.706658 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-adca4b5a-30a6-4150-b9ea-369e9fb13fed tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.010275 Dec 14 03:14:49.706978 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 16/28] 10.222.0.43 () {60 vars in 1146 bytes} [Tue Dec 14 03:14:46 2021] POST /compute/v2.1/servers => generated 383 bytes in 3012 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 14 03:14:49.782312 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-2b1ec690-8276-4045-a2f3-9a7803563643 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a8e0684f10464394e4f935d687cc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efcbf12d6654bc68690363892415b77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:14:49.804265 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-2b1ec690-8276-4045-a2f3-9a7803563643 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.43 "GET /compute/v2.1/servers/d9988bfe-afac-40fa-ad73-2db57dadf545" status: 200 len: 1315 microversion: 2.1 time: 0.782488 Dec 14 03:14:49.804881 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 13/29] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:14:49 2021] GET /compute/v2.1/servers/d9988bfe-afac-40fa-ad73-2db57dadf545 => generated 1315 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:14:49.822634 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-0c864d7b-2008-4ab8-8f23-ae9df45e5cdd tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:14:49.823222 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-0c864d7b-2008-4ab8-8f23-ae9df45e5cdd tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: 4687b559-c95a-4b82-a076-a7468c10ebef] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:14:50.109104 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-0c864d7b-2008-4ab8-8f23-ae9df45e5cdd tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:14:50.118899 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-0c864d7b-2008-4ab8-8f23-ae9df45e5cdd tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef" status: 200 len: 1222 microversion: 2.1 time: 0.312944 Dec 14 03:14:50.121892 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 14/30] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:14:49 2021] GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef => generated 1222 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:14:50.645570 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-1342b5d2-b691-456e-b41b-7ef9d7ae2125 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'create', calling method: .version_select at 0x7fa509441dc0>, body: {"keypair": {"name": "tempest-keypair-1181700061"}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:14:50.748235 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.quota [None req-1342b5d2-b691-456e-b41b-7ef9d7ae2125 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Getting quotas for project da53d564588b46b7bd658659f40a6ded. Resources: {'key_pairs'} {{(pid=116071) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 03:14:50.768433 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-2e3c6663-9de4-4edb-ba0b-2f80c1c02e36 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1301351279", "imageRef": "4fff76a9-6620-4bda-b1ec-2cd3719c946a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b4af40aa-6be1-48c2-866d-05aa1bdec9d3"}]}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:14:50.768768 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.quota [None req-1342b5d2-b691-456e-b41b-7ef9d7ae2125 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Getting quotas for user 0a4d52d1d56e44fe97650262ca2e68df and project da53d564588b46b7bd658659f40a6ded. Resources: {'key_pairs'} {{(pid=116071) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 03:14:50.941759 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.network.neutron [None req-2e3c6663-9de4-4edb-ba0b-2f80c1c02e36 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] validate_networks() for [('b4af40aa-6be1-48c2-866d-05aa1bdec9d3', None, None, None, None, None)] {{(pid=116072) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 14 03:14:52.181091 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.quota [None req-1342b5d2-b691-456e-b41b-7ef9d7ae2125 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Getting quotas for project da53d564588b46b7bd658659f40a6ded. Resources: {'key_pairs'} {{(pid=116071) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 03:14:52.199581 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.quota [None req-1342b5d2-b691-456e-b41b-7ef9d7ae2125 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Getting quotas for user 0a4d52d1d56e44fe97650262ca2e68df and project da53d564588b46b7bd658659f40a6ded. Resources: {'key_pairs'} {{(pid=116071) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 03:14:52.263844 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-1342b5d2-b691-456e-b41b-7ef9d7ae2125 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 2.546222 Dec 14 03:14:52.272240 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 17/31] 10.222.0.43 () {62 vars in 1198 bytes} [Tue Dec 14 03:14:49 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 2564 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Dec 14 03:14:52.304254 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-84cebf74-8d08-4038-8c29-d93d7c93a936 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:14:52.305405 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-84cebf74-8d08-4038-8c29-d93d7c93a936 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] [instance: d9988bfe-afac-40fa-ad73-2db57dadf545] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:14:52.315861 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-84cebf74-8d08-4038-8c29-d93d7c93a936 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:14:52.316473 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-84cebf74-8d08-4038-8c29-d93d7c93a936 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:14:52.318319 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-84cebf74-8d08-4038-8c29-d93d7c93a936 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:14:52.320616 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-84cebf74-8d08-4038-8c29-d93d7c93a936 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:14:52.368735 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-2e3c6663-9de4-4edb-ba0b-2f80c1c02e36 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Flavor limits 0:0:0 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 14 03:14:52.370431 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-2e3c6663-9de4-4edb-ba0b-2f80c1c02e36 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Image limits 0:0:0 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 14 03:14:52.371131 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-2e3c6663-9de4-4edb-ba0b-2f80c1c02e36 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Flavor pref 0:0:0 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 14 03:14:52.371709 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-2e3c6663-9de4-4edb-ba0b-2f80c1c02e36 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Image pref 0:0:0 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 14 03:14:52.372388 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-2e3c6663-9de4-4edb-ba0b-2f80c1c02e36 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 14 03:14:52.402705 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2e3c6663-9de4-4edb-ba0b-2f80c1c02e36 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:14:52.403240 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2e3c6663-9de4-4edb-ba0b-2f80c1c02e36 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:14:52.417474 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2e3c6663-9de4-4edb-ba0b-2f80c1c02e36 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:14:52.418017 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2e3c6663-9de4-4edb-ba0b-2f80c1c02e36 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:14:52.522929 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.quota [None req-2e3c6663-9de4-4edb-ba0b-2f80c1c02e36 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Getting quotas for project bb4be946dd9b4b2080fb3b398521624e. Resources: {'cores', 'instances', 'ram'} {{(pid=116072) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 03:14:52.538688 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.quota [None req-2e3c6663-9de4-4edb-ba0b-2f80c1c02e36 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Getting quotas for user 57a541b5dc154896bced57a79750a3c4 and project bb4be946dd9b4b2080fb3b398521624e. Resources: {'cores', 'instances', 'ram'} {{(pid=116072) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 03:14:52.590861 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-2e3c6663-9de4-4edb-ba0b-2f80c1c02e36 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Going to run 1 instances... {{(pid=116072) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 14 03:14:52.598563 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-2e3c6663-9de4-4edb-ba0b-2f80c1c02e36 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: c6283570-4ee2-47bc-b58a-fbfe57acbcde] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4fff76a9-6620-4bda-b1ec-2cd3719c946a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 14 03:14:52.729428 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-2e3c6663-9de4-4edb-ba0b-2f80c1c02e36 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.965876 Dec 14 03:14:52.741479 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 15/32] 10.222.0.43 () {60 vars in 1146 bytes} [Tue Dec 14 03:14:50 2021] POST /compute/v2.1/servers => generated 383 bytes in 1978 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 14 03:14:52.918250 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-84cebf74-8d08-4038-8c29-d93d7c93a936 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a8e0684f10464394e4f935d687cc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efcbf12d6654bc68690363892415b77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:14:52.930500 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-84cebf74-8d08-4038-8c29-d93d7c93a936 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.43 "GET /compute/v2.1/servers/d9988bfe-afac-40fa-ad73-2db57dadf545" status: 200 len: 1315 microversion: 2.1 time: 0.653568 Dec 14 03:14:52.937208 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 18/33] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:14:52 2021] GET /compute/v2.1/servers/d9988bfe-afac-40fa-ad73-2db57dadf545 => generated 1315 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:14:52.958619 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-395b803f-76d7-44d3-acbd-a98f45b7439d tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:14:52.962257 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-395b803f-76d7-44d3-acbd-a98f45b7439d tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: c6283570-4ee2-47bc-b58a-fbfe57acbcde] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:14:53.223179 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-395b803f-76d7-44d3-acbd-a98f45b7439d tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:14:53.241274 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-395b803f-76d7-44d3-acbd-a98f45b7439d tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde" status: 200 len: 1222 microversion: 2.1 time: 0.298536 Dec 14 03:14:53.264607 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 19/34] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:14:52 2021] GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde => generated 1222 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:14:53.318322 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [req-2490bce0-28a4-424b-ab33-c77db2f2d34c req-6b5fa78b-4310-4105-ba78-22234a9505ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9988bfe-afac-40fa-ad73-2db57dadf545", "tag": "9f8a517f-1b7e-4db6-ab49-7f2896db6aed"}]} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:14:53.322225 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:14:53.322225 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: warnings.warn(msg) Dec 14 03:14:53.358228 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-2490bce0-28a4-424b-ab33-c77db2f2d34c req-6b5fa78b-4310-4105-ba78-22234a9505ca service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:14:53.359669 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-2490bce0-28a4-424b-ab33-c77db2f2d34c req-6b5fa78b-4310-4105-ba78-22234a9505ca service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:14:53.429254 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.compute.server_external_events [req-2490bce0-28a4-424b-ab33-c77db2f2d34c req-6b5fa78b-4310-4105-ba78-22234a9505ca service nova] Creating event network-changed:9f8a517f-1b7e-4db6-ab49-7f2896db6aed for instance d9988bfe-afac-40fa-ad73-2db57dadf545 on hv-cinder-81803 Dec 14 03:14:53.431741 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-2490bce0-28a4-424b-ab33-c77db2f2d34c req-6b5fa78b-4310-4105-ba78-22234a9505ca service nova] Acquired lock "compute-rpcapi-router" {{(pid=116072) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Dec 14 03:14:53.433126 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1ce91575-2f66-4732-b2d1-3f9a15042559 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:14:53.443445 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1ce91575-2f66-4732-b2d1-3f9a15042559 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:14:53.444874 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1ce91575-2f66-4732-b2d1-3f9a15042559 None None] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:14:53.447766 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1ce91575-2f66-4732-b2d1-3f9a15042559 None None] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:14:53.495627 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.compute.rpcapi [None req-1ce91575-2f66-4732-b2d1-3f9a15042559 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Dec 14 03:14:53.496464 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1ce91575-2f66-4732-b2d1-3f9a15042559 None None] Releasing lock "compute-rpcapi-router" {{(pid=116072) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Dec 14 03:14:53.639487 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-1ce91575-2f66-4732-b2d1-3f9a15042559 None None] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.896471 Dec 14 03:14:53.640542 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 16/35] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Dec 14 03:14:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:14:53.954286 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-096bbafc-0c03-4170-b7ac-c131e6adb1a3 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:14:53.955679 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-096bbafc-0c03-4170-b7ac-c131e6adb1a3 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] [instance: d9988bfe-afac-40fa-ad73-2db57dadf545] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:14:53.980448 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-096bbafc-0c03-4170-b7ac-c131e6adb1a3 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:14:53.981144 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-096bbafc-0c03-4170-b7ac-c131e6adb1a3 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:14:53.998712 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-096bbafc-0c03-4170-b7ac-c131e6adb1a3 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:14:54.003311 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-096bbafc-0c03-4170-b7ac-c131e6adb1a3 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:14:54.275707 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-d9e73012-06e8-4b7b-b702-f574057bebb1 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:14:54.276434 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-d9e73012-06e8-4b7b-b702-f574057bebb1 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: c6283570-4ee2-47bc-b58a-fbfe57acbcde] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:14:54.295066 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d9e73012-06e8-4b7b-b702-f574057bebb1 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:14:54.295547 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d9e73012-06e8-4b7b-b702-f574057bebb1 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:14:54.296406 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d9e73012-06e8-4b7b-b702-f574057bebb1 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:14:54.296844 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d9e73012-06e8-4b7b-b702-f574057bebb1 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:14:54.975783 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-d9e73012-06e8-4b7b-b702-f574057bebb1 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:14:54.995918 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-d9e73012-06e8-4b7b-b702-f574057bebb1 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde" status: 200 len: 1218 microversion: 2.1 time: 0.725429 Dec 14 03:14:54.997456 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 17/36] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:14:54 2021] GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde => generated 1218 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 03:14:55.614902 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-096bbafc-0c03-4170-b7ac-c131e6adb1a3 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a8e0684f10464394e4f935d687cc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efcbf12d6654bc68690363892415b77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:14:55.630371 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-096bbafc-0c03-4170-b7ac-c131e6adb1a3 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.43 "GET /compute/v2.1/servers/d9988bfe-afac-40fa-ad73-2db57dadf545" status: 200 len: 1315 microversion: 2.1 time: 1.679102 Dec 14 03:14:55.631800 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 20/37] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:14:53 2021] GET /compute/v2.1/servers/d9988bfe-afac-40fa-ad73-2db57dadf545 => generated 1315 bytes in 1682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:14:56.023909 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-53a3fc08-805a-4148-acfe-1f32d1c5794c tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:14:56.024529 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-53a3fc08-805a-4148-acfe-1f32d1c5794c tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: c6283570-4ee2-47bc-b58a-fbfe57acbcde] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:14:56.035298 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-53a3fc08-805a-4148-acfe-1f32d1c5794c tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:14:56.039006 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-53a3fc08-805a-4148-acfe-1f32d1c5794c tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:14:56.041653 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-53a3fc08-805a-4148-acfe-1f32d1c5794c tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:14:56.042140 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-53a3fc08-805a-4148-acfe-1f32d1c5794c tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:14:56.540886 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-53a3fc08-805a-4148-acfe-1f32d1c5794c tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:14:56.549433 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-51a683f6-9cb5-4d8d-856d-9dee0f030cc6 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'create', calling method: .version_select at 0x7fa508b86c10>, body: {"keypair": {"name": "tempest-keypair-81813335"}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:14:56.575860 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-53a3fc08-805a-4148-acfe-1f32d1c5794c tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde" status: 200 len: 1292 microversion: 2.1 time: 0.557567 Dec 14 03:14:56.589234 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 18/38] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:14:56 2021] GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde => generated 1292 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:14:56.617800 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.quota [None req-51a683f6-9cb5-4d8d-856d-9dee0f030cc6 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Getting quotas for project 11634c00674445cb81d9dabfbcc791a8. Resources: {'key_pairs'} {{(pid=116071) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 03:14:56.628211 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.quota [None req-51a683f6-9cb5-4d8d-856d-9dee0f030cc6 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Getting quotas for user 107444106cda461dab7c403665d92613 and project 11634c00674445cb81d9dabfbcc791a8. Resources: {'key_pairs'} {{(pid=116071) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 03:14:56.663470 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-d5bd8660-5e8e-43f4-bae3-22af552848cb tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:14:56.664291 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-d5bd8660-5e8e-43f4-bae3-22af552848cb tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] [instance: d9988bfe-afac-40fa-ad73-2db57dadf545] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:14:56.690870 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d5bd8660-5e8e-43f4-bae3-22af552848cb tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:14:56.691457 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d5bd8660-5e8e-43f4-bae3-22af552848cb tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:14:56.692354 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d5bd8660-5e8e-43f4-bae3-22af552848cb tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:14:56.693314 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d5bd8660-5e8e-43f4-bae3-22af552848cb tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:14:57.204286 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.quota [None req-51a683f6-9cb5-4d8d-856d-9dee0f030cc6 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Getting quotas for project 11634c00674445cb81d9dabfbcc791a8. Resources: {'key_pairs'} {{(pid=116071) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 03:14:57.209384 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.quota [None req-51a683f6-9cb5-4d8d-856d-9dee0f030cc6 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Getting quotas for user 107444106cda461dab7c403665d92613 and project 11634c00674445cb81d9dabfbcc791a8. Resources: {'key_pairs'} {{(pid=116071) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 03:14:57.236818 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-51a683f6-9cb5-4d8d-856d-9dee0f030cc6 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 2303 microversion: 2.1 time: 1.136975 Dec 14 03:14:57.243759 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 21/39] 10.222.0.43 () {60 vars in 1157 bytes} [Tue Dec 14 03:14:56 2021] POST /compute/v2.1/os-keypairs => generated 2303 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:14:57.605528 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-319e6fc3-9287-4d94-98b9-19abe5670de2 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:14:57.606604 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-319e6fc3-9287-4d94-98b9-19abe5670de2 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: c6283570-4ee2-47bc-b58a-fbfe57acbcde] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:14:57.618276 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-319e6fc3-9287-4d94-98b9-19abe5670de2 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:14:57.619775 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-319e6fc3-9287-4d94-98b9-19abe5670de2 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:14:57.624464 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-319e6fc3-9287-4d94-98b9-19abe5670de2 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:14:57.625800 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-319e6fc3-9287-4d94-98b9-19abe5670de2 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:14:57.648505 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-d5bd8660-5e8e-43f4-bae3-22af552848cb tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a8e0684f10464394e4f935d687cc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efcbf12d6654bc68690363892415b77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:14:57.656542 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-d5bd8660-5e8e-43f4-bae3-22af552848cb tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.43 "GET /compute/v2.1/servers/d9988bfe-afac-40fa-ad73-2db57dadf545" status: 200 len: 1315 microversion: 2.1 time: 0.998743 Dec 14 03:14:57.657114 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 19/40] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:14:56 2021] GET /compute/v2.1/servers/d9988bfe-afac-40fa-ad73-2db57dadf545 => generated 1315 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:14:57.782202 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-319e6fc3-9287-4d94-98b9-19abe5670de2 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:14:57.792704 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-319e6fc3-9287-4d94-98b9-19abe5670de2 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde" status: 200 len: 1280 microversion: 2.1 time: 0.190961 Dec 14 03:14:57.795109 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 22/41] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:14:57 2021] GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde => generated 1280 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 03:14:58.674288 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-bf547ac0-c193-4941-97e3-8bb9674054c7 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:14:58.675614 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-bf547ac0-c193-4941-97e3-8bb9674054c7 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] [instance: d9988bfe-afac-40fa-ad73-2db57dadf545] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:14:58.690535 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-bf547ac0-c193-4941-97e3-8bb9674054c7 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:14:58.694120 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-bf547ac0-c193-4941-97e3-8bb9674054c7 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:14:58.696686 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-bf547ac0-c193-4941-97e3-8bb9674054c7 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:14:58.698606 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-bf547ac0-c193-4941-97e3-8bb9674054c7 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:14:58.812673 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-4827d556-2650-4092-8469-479ae41c5009 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:14:58.814659 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-4827d556-2650-4092-8469-479ae41c5009 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: c6283570-4ee2-47bc-b58a-fbfe57acbcde] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:14:58.829796 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-4827d556-2650-4092-8469-479ae41c5009 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:14:58.835394 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-4827d556-2650-4092-8469-479ae41c5009 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:14:58.837789 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-4827d556-2650-4092-8469-479ae41c5009 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:14:58.840043 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-4827d556-2650-4092-8469-479ae41c5009 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:14:58.918561 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-bf547ac0-c193-4941-97e3-8bb9674054c7 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a8e0684f10464394e4f935d687cc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efcbf12d6654bc68690363892415b77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:14:58.930753 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-bf547ac0-c193-4941-97e3-8bb9674054c7 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.43 "GET /compute/v2.1/servers/d9988bfe-afac-40fa-ad73-2db57dadf545" status: 200 len: 1315 microversion: 2.1 time: 0.258621 Dec 14 03:14:58.931400 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 20/42] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:14:58 2021] GET /compute/v2.1/servers/d9988bfe-afac-40fa-ad73-2db57dadf545 => generated 1315 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:14:58.967615 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-4827d556-2650-4092-8469-479ae41c5009 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:14:58.977308 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-4827d556-2650-4092-8469-479ae41c5009 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde" status: 200 len: 1280 microversion: 2.1 time: 0.169139 Dec 14 03:14:58.977794 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 23/43] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:14:58 2021] GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde => generated 1280 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:14:59.947868 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-c0037086-b3d3-4007-999f-397aa55cadfe tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:14:59.948575 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-c0037086-b3d3-4007-999f-397aa55cadfe tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] [instance: d9988bfe-afac-40fa-ad73-2db57dadf545] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:14:59.961305 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c0037086-b3d3-4007-999f-397aa55cadfe tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:14:59.961819 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c0037086-b3d3-4007-999f-397aa55cadfe tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:14:59.963017 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c0037086-b3d3-4007-999f-397aa55cadfe tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:14:59.963534 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c0037086-b3d3-4007-999f-397aa55cadfe tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:14:59.993791 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-d46d7016-e4c3-40e2-ae51-fc11589a0fea tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:14:59.994415 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-d46d7016-e4c3-40e2-ae51-fc11589a0fea tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: c6283570-4ee2-47bc-b58a-fbfe57acbcde] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:00.005626 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-d46d7016-e4c3-40e2-ae51-fc11589a0fea tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:00.009415 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-d46d7016-e4c3-40e2-ae51-fc11589a0fea tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:00.014697 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-d46d7016-e4c3-40e2-ae51-fc11589a0fea tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:00.015083 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-d46d7016-e4c3-40e2-ae51-fc11589a0fea tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:00.819432 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-d46d7016-e4c3-40e2-ae51-fc11589a0fea tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:00.840837 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-d46d7016-e4c3-40e2-ae51-fc11589a0fea tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde" status: 200 len: 1322 microversion: 2.1 time: 0.850626 Dec 14 03:15:00.841453 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 24/44] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:14:59 2021] GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde => generated 1322 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 03:15:01.220937 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-c0037086-b3d3-4007-999f-397aa55cadfe tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a8e0684f10464394e4f935d687cc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efcbf12d6654bc68690363892415b77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:01.228944 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-c0037086-b3d3-4007-999f-397aa55cadfe tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.43 "GET /compute/v2.1/servers/d9988bfe-afac-40fa-ad73-2db57dadf545" status: 200 len: 1315 microversion: 2.1 time: 1.284876 Dec 14 03:15:01.241548 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 21/45] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:14:59 2021] GET /compute/v2.1/servers/d9988bfe-afac-40fa-ad73-2db57dadf545 => generated 1315 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:15:01.280587 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-a21b6538-5697-451e-9654-37242ea7d400 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-547563401", "imageRef": "4fff76a9-6620-4bda-b1ec-2cd3719c946a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "61e8c126-6b7d-4549-9293-90629e6175d3"}], "security_groups": [{"name": "tempest-securitygroup--1499886672"}], "key_name": "tempest-keypair-1181700061", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:15:01.648203 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.network.neutron [None req-a21b6538-5697-451e-9654-37242ea7d400 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] validate_networks() for [('61e8c126-6b7d-4549-9293-90629e6175d3', None, None, None, None, None)] {{(pid=116071) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 14 03:15:01.857362 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-14f31cd7-d235-4914-aa01-af3f72ec04b3 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:01.858511 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-14f31cd7-d235-4914-aa01-af3f72ec04b3 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: c6283570-4ee2-47bc-b58a-fbfe57acbcde] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:01.865991 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-14f31cd7-d235-4914-aa01-af3f72ec04b3 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:01.870526 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-14f31cd7-d235-4914-aa01-af3f72ec04b3 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:01.871932 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-14f31cd7-d235-4914-aa01-af3f72ec04b3 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:01.874352 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-14f31cd7-d235-4914-aa01-af3f72ec04b3 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:02.455366 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-14f31cd7-d235-4914-aa01-af3f72ec04b3 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:02.465039 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-14f31cd7-d235-4914-aa01-af3f72ec04b3 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde" status: 200 len: 1322 microversion: 2.1 time: 0.611182 Dec 14 03:15:02.470492 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 22/46] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:15:01 2021] GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde => generated 1322 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:15:02.481965 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-9d326cf7-e99d-4c55-8c25-45e8df0c500e tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:02.486102 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-9d326cf7-e99d-4c55-8c25-45e8df0c500e tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] [instance: d9988bfe-afac-40fa-ad73-2db57dadf545] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:02.502077 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9d326cf7-e99d-4c55-8c25-45e8df0c500e tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:02.503923 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9d326cf7-e99d-4c55-8c25-45e8df0c500e tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:02.506967 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9d326cf7-e99d-4c55-8c25-45e8df0c500e tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:02.508121 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9d326cf7-e99d-4c55-8c25-45e8df0c500e tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:03.179854 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-9d326cf7-e99d-4c55-8c25-45e8df0c500e tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a8e0684f10464394e4f935d687cc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efcbf12d6654bc68690363892415b77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:03.190524 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-9d326cf7-e99d-4c55-8c25-45e8df0c500e tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.43 "GET /compute/v2.1/servers/d9988bfe-afac-40fa-ad73-2db57dadf545" status: 200 len: 1315 microversion: 2.1 time: 0.718437 Dec 14 03:15:03.193209 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 23/47] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:15:02 2021] GET /compute/v2.1/servers/d9988bfe-afac-40fa-ad73-2db57dadf545 => generated 1315 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:15:03.201304 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [req-d11f58ac-f590-4b15-b4ad-0a475b18e2d3 req-ddf2299a-0cb3-4cee-90f9-f64ad1dc6da1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6283570-4ee2-47bc-b58a-fbfe57acbcde", "tag": "4b8834a4-3f18-49ea-b3a2-4053d903f624"}]} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:15:03.215113 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:15:03.215113 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: warnings.warn(msg) Dec 14 03:15:03.223857 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-d11f58ac-f590-4b15-b4ad-0a475b18e2d3 req-ddf2299a-0cb3-4cee-90f9-f64ad1dc6da1 service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:03.224310 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-d11f58ac-f590-4b15-b4ad-0a475b18e2d3 req-ddf2299a-0cb3-4cee-90f9-f64ad1dc6da1 service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:03.243399 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.compute.server_external_events [req-d11f58ac-f590-4b15-b4ad-0a475b18e2d3 req-ddf2299a-0cb3-4cee-90f9-f64ad1dc6da1 service nova] Creating event network-changed:4b8834a4-3f18-49ea-b3a2-4053d903f624 for instance c6283570-4ee2-47bc-b58a-fbfe57acbcde on hv-cinder-81803 Dec 14 03:15:03.252936 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [req-d11f58ac-f590-4b15-b4ad-0a475b18e2d3 req-ddf2299a-0cb3-4cee-90f9-f64ad1dc6da1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057395 Dec 14 03:15:03.256598 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 24/48] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Dec 14 03:15:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:15:03.487334 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.virt.hardware [None req-a21b6538-5697-451e-9654-37242ea7d400 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Flavor limits 0:0:0 {{(pid=116071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 14 03:15:03.487869 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.virt.hardware [None req-a21b6538-5697-451e-9654-37242ea7d400 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Image limits 0:0:0 {{(pid=116071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 14 03:15:03.488819 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.virt.hardware [None req-a21b6538-5697-451e-9654-37242ea7d400 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Flavor pref 0:0:0 {{(pid=116071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 14 03:15:03.490047 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.virt.hardware [None req-a21b6538-5697-451e-9654-37242ea7d400 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Image pref 0:0:0 {{(pid=116071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 14 03:15:03.490688 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.virt.hardware [None req-a21b6538-5697-451e-9654-37242ea7d400 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 14 03:15:03.504443 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a21b6538-5697-451e-9654-37242ea7d400 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:03.513761 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a21b6538-5697-451e-9654-37242ea7d400 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:03.514969 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a21b6538-5697-451e-9654-37242ea7d400 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:03.515659 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a21b6538-5697-451e-9654-37242ea7d400 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:03.583408 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.quota [None req-a21b6538-5697-451e-9654-37242ea7d400 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Getting quotas for project da53d564588b46b7bd658659f40a6ded. Resources: {'cores', 'instances', 'ram'} {{(pid=116071) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 03:15:03.595674 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.quota [None req-a21b6538-5697-451e-9654-37242ea7d400 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Getting quotas for user 0a4d52d1d56e44fe97650262ca2e68df and project da53d564588b46b7bd658659f40a6ded. Resources: {'cores', 'instances', 'ram'} {{(pid=116071) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 03:15:03.629023 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-a21b6538-5697-451e-9654-37242ea7d400 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Going to run 1 instances... {{(pid=116071) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 14 03:15:03.633629 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-a21b6538-5697-451e-9654-37242ea7d400 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4fff76a9-6620-4bda-b1ec-2cd3719c946a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 14 03:15:03.670891 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [req-1a1eb197-6e11-43a1-904a-e1148d611e59 req-0ce74b7f-166e-418c-bd93-195aadf00c5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4687b559-c95a-4b82-a076-a7468c10ebef", "tag": "9d0f1802-5b85-4dd7-847f-3cdd0b182adf"}]} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:15:03.677452 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:15:03.677452 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: warnings.warn(msg) Dec 14 03:15:03.693757 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-1a1eb197-6e11-43a1-904a-e1148d611e59 req-0ce74b7f-166e-418c-bd93-195aadf00c5b service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:03.697421 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-1a1eb197-6e11-43a1-904a-e1148d611e59 req-0ce74b7f-166e-418c-bd93-195aadf00c5b service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:03.726900 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.compute.server_external_events [req-1a1eb197-6e11-43a1-904a-e1148d611e59 req-0ce74b7f-166e-418c-bd93-195aadf00c5b service nova] Creating event network-changed:9d0f1802-5b85-4dd7-847f-3cdd0b182adf for instance 4687b559-c95a-4b82-a076-a7468c10ebef on hv-cinder-81803 Dec 14 03:15:03.730705 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-a21b6538-5697-451e-9654-37242ea7d400 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.455761 Dec 14 03:15:03.732002 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 25/49] 10.222.0.43 () {62 vars in 1187 bytes} [Tue Dec 14 03:15:01 2021] POST /compute/v2.1/servers => generated 402 bytes in 2458 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Dec 14 03:15:03.739560 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-3c76c02f-7ed1-458e-862f-842b98af8e5d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1508959363", "imageRef": "4fff76a9-6620-4bda-b1ec-2cd3719c946a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7e397d2e-d5ba-40c3-8051-57991a288ab3"}], "security_groups": [{"name": "tempest-securitygroup--1831167770"}], "key_name": "tempest-keypair-81813335", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:15:03.753255 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [req-1a1eb197-6e11-43a1-904a-e1148d611e59 req-0ce74b7f-166e-418c-bd93-195aadf00c5b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.494991 Dec 14 03:15:03.754124 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 25/50] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Dec 14 03:15:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:15:03.761462 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-21801618-7ffa-4647-9ed6-3beaa34c05ca tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:03.769680 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-21801618-7ffa-4647-9ed6-3beaa34c05ca tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: c6283570-4ee2-47bc-b58a-fbfe57acbcde] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:03.785430 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-21801618-7ffa-4647-9ed6-3beaa34c05ca tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:03.786846 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-21801618-7ffa-4647-9ed6-3beaa34c05ca tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:03.788253 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-21801618-7ffa-4647-9ed6-3beaa34c05ca tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:03.788888 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-21801618-7ffa-4647-9ed6-3beaa34c05ca tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:03.971564 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.network.neutron [None req-3c76c02f-7ed1-458e-862f-842b98af8e5d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] validate_networks() for [('7e397d2e-d5ba-40c3-8051-57991a288ab3', None, None, None, None, None)] {{(pid=116071) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 14 03:15:04.799992 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-21801618-7ffa-4647-9ed6-3beaa34c05ca tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:04.813906 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-21801618-7ffa-4647-9ed6-3beaa34c05ca tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde" status: 200 len: 1322 microversion: 2.1 time: 1.055888 Dec 14 03:15:04.816566 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 26/51] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:15:03 2021] GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde => generated 1322 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:15:04.841618 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-b76877f7-cb3f-4901-998a-2cdd8d2fd7bf tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:04.842262 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-b76877f7-cb3f-4901-998a-2cdd8d2fd7bf tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:04.863716 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b76877f7-cb3f-4901-998a-2cdd8d2fd7bf tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:04.864500 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b76877f7-cb3f-4901-998a-2cdd8d2fd7bf tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:04.865557 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b76877f7-cb3f-4901-998a-2cdd8d2fd7bf tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:04.866151 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b76877f7-cb3f-4901-998a-2cdd8d2fd7bf tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:05.021466 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-b76877f7-cb3f-4901-998a-2cdd8d2fd7bf tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:05.036450 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-b76877f7-cb3f-4901-998a-2cdd8d2fd7bf tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:05.041073 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-b76877f7-cb3f-4901-998a-2cdd8d2fd7bf tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:05.044134 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-b76877f7-cb3f-4901-998a-2cdd8d2fd7bf tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1333 microversion: 2.20 time: 0.225024 Dec 14 03:15:05.047673 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 27/52] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:15:04 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1333 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:15:05.057485 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-c4a768c2-5ce8-41a0-b580-b38d2791f6df tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:05.058490 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-c4a768c2-5ce8-41a0-b580-b38d2791f6df tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] [instance: d9988bfe-afac-40fa-ad73-2db57dadf545] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:05.084215 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c4a768c2-5ce8-41a0-b580-b38d2791f6df tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:05.084781 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c4a768c2-5ce8-41a0-b580-b38d2791f6df tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:05.088510 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c4a768c2-5ce8-41a0-b580-b38d2791f6df tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:05.089147 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c4a768c2-5ce8-41a0-b580-b38d2791f6df tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:05.377389 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.virt.hardware [None req-3c76c02f-7ed1-458e-862f-842b98af8e5d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Flavor limits 0:0:0 {{(pid=116071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 14 03:15:05.378576 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.virt.hardware [None req-3c76c02f-7ed1-458e-862f-842b98af8e5d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Image limits 0:0:0 {{(pid=116071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 14 03:15:05.379148 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.virt.hardware [None req-3c76c02f-7ed1-458e-862f-842b98af8e5d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Flavor pref 0:0:0 {{(pid=116071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 14 03:15:05.379713 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.virt.hardware [None req-3c76c02f-7ed1-458e-862f-842b98af8e5d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Image pref 0:0:0 {{(pid=116071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 14 03:15:05.380173 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.virt.hardware [None req-3c76c02f-7ed1-458e-862f-842b98af8e5d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 14 03:15:05.403439 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-3c76c02f-7ed1-458e-862f-842b98af8e5d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:05.404162 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-3c76c02f-7ed1-458e-862f-842b98af8e5d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:05.405197 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-3c76c02f-7ed1-458e-862f-842b98af8e5d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:05.408007 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-3c76c02f-7ed1-458e-862f-842b98af8e5d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:05.408193 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-c4a768c2-5ce8-41a0-b580-b38d2791f6df tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a8e0684f10464394e4f935d687cc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efcbf12d6654bc68690363892415b77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:05.419808 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-c4a768c2-5ce8-41a0-b580-b38d2791f6df tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.43 "GET /compute/v2.1/servers/d9988bfe-afac-40fa-ad73-2db57dadf545" status: 200 len: 1315 microversion: 2.1 time: 0.370757 Dec 14 03:15:05.420391 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 28/53] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:15:05 2021] GET /compute/v2.1/servers/d9988bfe-afac-40fa-ad73-2db57dadf545 => generated 1315 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:15:05.501836 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.quota [None req-3c76c02f-7ed1-458e-862f-842b98af8e5d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Getting quotas for project 11634c00674445cb81d9dabfbcc791a8. Resources: {'cores', 'instances', 'ram'} {{(pid=116071) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 03:15:05.523380 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.quota [None req-3c76c02f-7ed1-458e-862f-842b98af8e5d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Getting quotas for user 107444106cda461dab7c403665d92613 and project 11634c00674445cb81d9dabfbcc791a8. Resources: {'cores', 'instances', 'ram'} {{(pid=116071) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 03:15:05.568676 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-3c76c02f-7ed1-458e-862f-842b98af8e5d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Going to run 1 instances... {{(pid=116071) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 14 03:15:05.570911 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-3c76c02f-7ed1-458e-862f-842b98af8e5d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4fff76a9-6620-4bda-b1ec-2cd3719c946a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 14 03:15:05.663854 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-3c76c02f-7ed1-458e-862f-842b98af8e5d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.930224 Dec 14 03:15:05.664417 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 26/54] 10.222.0.43 () {60 vars in 1146 bytes} [Tue Dec 14 03:15:03 2021] POST /compute/v2.1/servers => generated 402 bytes in 1932 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 14 03:15:05.678873 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-fac75e47-6cb5-4a7b-a895-a68a215fe88f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:05.680357 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-fac75e47-6cb5-4a7b-a895-a68a215fe88f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:05.762077 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-fac75e47-6cb5-4a7b-a895-a68a215fe88f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107444106cda461dab7c403665d92613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:05.769280 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-fac75e47-6cb5-4a7b-a895-a68a215fe88f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364" status: 200 len: 1236 microversion: 2.1 time: 0.098054 Dec 14 03:15:05.772158 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 29/55] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:15:05 2021] GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364 => generated 1236 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:15:05.835687 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-b07d3b71-a52d-427d-a307-3af3ec18269b tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:05.836426 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-b07d3b71-a52d-427d-a307-3af3ec18269b tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: c6283570-4ee2-47bc-b58a-fbfe57acbcde] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:05.860001 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b07d3b71-a52d-427d-a307-3af3ec18269b tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:05.860456 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b07d3b71-a52d-427d-a307-3af3ec18269b tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:05.861253 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b07d3b71-a52d-427d-a307-3af3ec18269b tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:05.861870 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b07d3b71-a52d-427d-a307-3af3ec18269b tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:06.066587 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-c35f2780-3cd9-4885-9ec4-432cd19b8a2e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:06.068234 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-c35f2780-3cd9-4885-9ec4-432cd19b8a2e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:06.090671 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-b07d3b71-a52d-427d-a307-3af3ec18269b tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:06.097269 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c35f2780-3cd9-4885-9ec4-432cd19b8a2e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:06.100774 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c35f2780-3cd9-4885-9ec4-432cd19b8a2e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:06.107156 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c35f2780-3cd9-4885-9ec4-432cd19b8a2e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:06.109475 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c35f2780-3cd9-4885-9ec4-432cd19b8a2e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:06.121925 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-b07d3b71-a52d-427d-a307-3af3ec18269b tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde" status: 200 len: 1322 microversion: 2.1 time: 0.281374 Dec 14 03:15:06.123813 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 27/56] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:15:05 2021] GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde => generated 1322 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:15:06.291202 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-c35f2780-3cd9-4885-9ec4-432cd19b8a2e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:06.305993 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-c35f2780-3cd9-4885-9ec4-432cd19b8a2e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:06.308264 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-c35f2780-3cd9-4885-9ec4-432cd19b8a2e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:06.312690 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-c35f2780-3cd9-4885-9ec4-432cd19b8a2e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1339 microversion: 2.20 time: 0.250715 Dec 14 03:15:06.313747 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 30/57] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:15:06 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1339 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:15:06.437915 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-2cd93ad8-6f91-4d8c-b593-bae527852789 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:06.438529 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-2cd93ad8-6f91-4d8c-b593-bae527852789 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] [instance: d9988bfe-afac-40fa-ad73-2db57dadf545] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:06.460882 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-2cd93ad8-6f91-4d8c-b593-bae527852789 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:06.461341 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-2cd93ad8-6f91-4d8c-b593-bae527852789 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:06.462143 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-2cd93ad8-6f91-4d8c-b593-bae527852789 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:06.462585 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-2cd93ad8-6f91-4d8c-b593-bae527852789 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:06.797859 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-8e7fe401-0c8c-4988-8529-2e9702373c53 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:06.798485 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-8e7fe401-0c8c-4988-8529-2e9702373c53 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:06.807348 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8e7fe401-0c8c-4988-8529-2e9702373c53 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:06.807810 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8e7fe401-0c8c-4988-8529-2e9702373c53 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:06.808616 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8e7fe401-0c8c-4988-8529-2e9702373c53 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:06.809061 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8e7fe401-0c8c-4988-8529-2e9702373c53 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:06.832968 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-2cd93ad8-6f91-4d8c-b593-bae527852789 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a8e0684f10464394e4f935d687cc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efcbf12d6654bc68690363892415b77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:06.842911 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-2cd93ad8-6f91-4d8c-b593-bae527852789 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.43 "GET /compute/v2.1/servers/d9988bfe-afac-40fa-ad73-2db57dadf545" status: 200 len: 1315 microversion: 2.1 time: 0.408721 Dec 14 03:15:06.844936 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 28/58] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:15:06 2021] GET /compute/v2.1/servers/d9988bfe-afac-40fa-ad73-2db57dadf545 => generated 1315 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:15:06.968520 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-8e7fe401-0c8c-4988-8529-2e9702373c53 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107444106cda461dab7c403665d92613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:06.982150 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-8e7fe401-0c8c-4988-8529-2e9702373c53 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364" status: 200 len: 1288 microversion: 2.1 time: 0.187904 Dec 14 03:15:06.982725 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 31/59] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:15:06 2021] GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364 => generated 1288 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:15:07.149606 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-27135762-9a9a-4d88-a48d-4d5279538384 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:07.149606 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-27135762-9a9a-4d88-a48d-4d5279538384 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: c6283570-4ee2-47bc-b58a-fbfe57acbcde] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:07.151462 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-27135762-9a9a-4d88-a48d-4d5279538384 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:07.151930 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-27135762-9a9a-4d88-a48d-4d5279538384 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:07.152742 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-27135762-9a9a-4d88-a48d-4d5279538384 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:07.156413 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-27135762-9a9a-4d88-a48d-4d5279538384 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:07.352841 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-6e6b4e99-9910-4be9-b38b-ed90df40e779 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:07.356323 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-6e6b4e99-9910-4be9-b38b-ed90df40e779 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:07.366929 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6e6b4e99-9910-4be9-b38b-ed90df40e779 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:07.367956 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6e6b4e99-9910-4be9-b38b-ed90df40e779 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:07.369699 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6e6b4e99-9910-4be9-b38b-ed90df40e779 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:07.370608 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6e6b4e99-9910-4be9-b38b-ed90df40e779 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:07.584910 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-27135762-9a9a-4d88-a48d-4d5279538384 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:07.593998 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-27135762-9a9a-4d88-a48d-4d5279538384 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde" status: 200 len: 1322 microversion: 2.1 time: 0.458453 Dec 14 03:15:07.606308 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 29/60] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:15:07 2021] GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde => generated 1322 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:15:07.711603 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-6e6b4e99-9910-4be9-b38b-ed90df40e779 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:07.741450 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-6e6b4e99-9910-4be9-b38b-ed90df40e779 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:07.742133 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [req-b850fa77-0c3f-401d-87ac-889d44387396 req-d2c9b702-41db-4b32-8dd1-b75d34b91f3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86395107-d320-45d8-83de-f1848858be10", "tag": "85ceb16f-0c27-48e9-ab76-5cd49eb12802"}]} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:15:07.744990 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:15:07.744990 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: warnings.warn(msg) Dec 14 03:15:07.746672 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-6e6b4e99-9910-4be9-b38b-ed90df40e779 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:07.754269 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-6e6b4e99-9910-4be9-b38b-ed90df40e779 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1407 microversion: 2.20 time: 0.418900 Dec 14 03:15:07.758008 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [req-b850fa77-0c3f-401d-87ac-889d44387396 req-d2c9b702-41db-4b32-8dd1-b75d34b91f3c service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:07.759839 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [req-b850fa77-0c3f-401d-87ac-889d44387396 req-d2c9b702-41db-4b32-8dd1-b75d34b91f3c service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:07.760152 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 32/61] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:15:07 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1407 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 14 03:15:07.788460 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.compute.server_external_events [req-b850fa77-0c3f-401d-87ac-889d44387396 req-d2c9b702-41db-4b32-8dd1-b75d34b91f3c service nova] Creating event network-changed:85ceb16f-0c27-48e9-ab76-5cd49eb12802 for instance 86395107-d320-45d8-83de-f1848858be10 on hv-cinder-81803 Dec 14 03:15:07.789284 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [req-b850fa77-0c3f-401d-87ac-889d44387396 req-d2c9b702-41db-4b32-8dd1-b75d34b91f3c service nova] Acquired lock "compute-rpcapi-router" {{(pid=116071) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Dec 14 03:15:07.790774 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ec291700-ce5c-4e13-bb69-5c31be3b4e32 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:07.791459 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ec291700-ce5c-4e13-bb69-5c31be3b4e32 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:07.792631 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ec291700-ce5c-4e13-bb69-5c31be3b4e32 None None] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:07.793248 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ec291700-ce5c-4e13-bb69-5c31be3b4e32 None None] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:07.803544 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.compute.rpcapi [None req-ec291700-ce5c-4e13-bb69-5c31be3b4e32 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Dec 14 03:15:07.804724 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ec291700-ce5c-4e13-bb69-5c31be3b4e32 None None] Releasing lock "compute-rpcapi-router" {{(pid=116071) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Dec 14 03:15:07.849371 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-ec291700-ce5c-4e13-bb69-5c31be3b4e32 None None] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104191 Dec 14 03:15:07.850413 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 30/62] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Dec 14 03:15:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:15:07.864368 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-21e66422-e61d-4f5b-a6a1-53cb8874cbb3 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:07.865005 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-21e66422-e61d-4f5b-a6a1-53cb8874cbb3 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] [instance: d9988bfe-afac-40fa-ad73-2db57dadf545] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:07.883646 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-21e66422-e61d-4f5b-a6a1-53cb8874cbb3 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:07.883646 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-21e66422-e61d-4f5b-a6a1-53cb8874cbb3 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:07.883646 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-21e66422-e61d-4f5b-a6a1-53cb8874cbb3 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:07.891400 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-21e66422-e61d-4f5b-a6a1-53cb8874cbb3 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:08.000963 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-11d116f2-bf08-4662-8bd1-90ca0c6f030c tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:08.001851 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-11d116f2-bf08-4662-8bd1-90ca0c6f030c tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:08.016422 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-11d116f2-bf08-4662-8bd1-90ca0c6f030c tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:08.020361 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-11d116f2-bf08-4662-8bd1-90ca0c6f030c tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:08.021326 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-11d116f2-bf08-4662-8bd1-90ca0c6f030c tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:08.023732 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-11d116f2-bf08-4662-8bd1-90ca0c6f030c tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:08.225859 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-11d116f2-bf08-4662-8bd1-90ca0c6f030c tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107444106cda461dab7c403665d92613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:08.243252 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-11d116f2-bf08-4662-8bd1-90ca0c6f030c tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364" status: 200 len: 1294 microversion: 2.1 time: 0.246432 Dec 14 03:15:08.249133 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 31/63] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:15:07 2021] GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364 => generated 1294 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 03:15:08.612187 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-3d1530bc-e5eb-4570-9abf-5cf53df95f73 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:08.613523 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-3d1530bc-e5eb-4570-9abf-5cf53df95f73 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: c6283570-4ee2-47bc-b58a-fbfe57acbcde] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:08.623531 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-3d1530bc-e5eb-4570-9abf-5cf53df95f73 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:08.629098 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-3d1530bc-e5eb-4570-9abf-5cf53df95f73 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:08.631640 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-3d1530bc-e5eb-4570-9abf-5cf53df95f73 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:08.632639 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-3d1530bc-e5eb-4570-9abf-5cf53df95f73 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:08.842736 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-21e66422-e61d-4f5b-a6a1-53cb8874cbb3 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a8e0684f10464394e4f935d687cc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efcbf12d6654bc68690363892415b77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:08.854038 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-21e66422-e61d-4f5b-a6a1-53cb8874cbb3 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.43 "GET /compute/v2.1/servers/d9988bfe-afac-40fa-ad73-2db57dadf545" status: 200 len: 1315 microversion: 2.1 time: 0.995244 Dec 14 03:15:08.855390 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 33/64] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:15:07 2021] GET /compute/v2.1/servers/d9988bfe-afac-40fa-ad73-2db57dadf545 => generated 1315 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:15:09.075220 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [req-b31a118a-e623-42ef-9246-375c878599a3 req-f707cdf7-3905-42de-a85d-c354a47839f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9988bfe-afac-40fa-ad73-2db57dadf545", "name": "network-vif-plugged", "status": "completed", "tag": "9f8a517f-1b7e-4db6-ab49-7f2896db6aed"}]} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:15:09.077985 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:15:09.077985 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: warnings.warn(msg) Dec 14 03:15:09.087154 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-b31a118a-e623-42ef-9246-375c878599a3 req-f707cdf7-3905-42de-a85d-c354a47839f0 service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:09.089891 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-b31a118a-e623-42ef-9246-375c878599a3 req-f707cdf7-3905-42de-a85d-c354a47839f0 service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:09.103850 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.compute.server_external_events [req-b31a118a-e623-42ef-9246-375c878599a3 req-f707cdf7-3905-42de-a85d-c354a47839f0 service nova] Creating event network-vif-plugged:9f8a517f-1b7e-4db6-ab49-7f2896db6aed for instance d9988bfe-afac-40fa-ad73-2db57dadf545 on hv-cinder-81803 Dec 14 03:15:09.111413 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [req-b31a118a-e623-42ef-9246-375c878599a3 req-f707cdf7-3905-42de-a85d-c354a47839f0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.250494 Dec 14 03:15:09.118160 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 34/65] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Dec 14 03:15:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:15:09.124357 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-f6ca8da4-69ad-4ddb-8256-d67069642143 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:09.125141 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-f6ca8da4-69ad-4ddb-8256-d67069642143 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:09.131601 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f6ca8da4-69ad-4ddb-8256-d67069642143 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:09.132477 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f6ca8da4-69ad-4ddb-8256-d67069642143 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:09.134240 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f6ca8da4-69ad-4ddb-8256-d67069642143 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:09.134508 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f6ca8da4-69ad-4ddb-8256-d67069642143 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:09.209061 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-3d1530bc-e5eb-4570-9abf-5cf53df95f73 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:09.217979 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-3d1530bc-e5eb-4570-9abf-5cf53df95f73 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde" status: 200 len: 1322 microversion: 2.1 time: 0.609537 Dec 14 03:15:09.223620 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 32/66] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:15:08 2021] GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde => generated 1322 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 03:15:09.266036 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-6e503658-007a-470e-a8f6-8b70701564a7 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:09.266669 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-6e503658-007a-470e-a8f6-8b70701564a7 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:09.276506 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-6e503658-007a-470e-a8f6-8b70701564a7 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:09.276967 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-6e503658-007a-470e-a8f6-8b70701564a7 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:09.277770 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-6e503658-007a-470e-a8f6-8b70701564a7 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:09.278215 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-6e503658-007a-470e-a8f6-8b70701564a7 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:09.472932 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-6e503658-007a-470e-a8f6-8b70701564a7 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107444106cda461dab7c403665d92613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:09.480851 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-6e503658-007a-470e-a8f6-8b70701564a7 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364" status: 200 len: 1294 microversion: 2.1 time: 0.218409 Dec 14 03:15:09.481425 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 33/67] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:15:09 2021] GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364 => generated 1294 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:15:09.602549 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-f6ca8da4-69ad-4ddb-8256-d67069642143 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:09.623368 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-f6ca8da4-69ad-4ddb-8256-d67069642143 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:09.625407 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-f6ca8da4-69ad-4ddb-8256-d67069642143 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:09.627181 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-f6ca8da4-69ad-4ddb-8256-d67069642143 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1407 microversion: 2.20 time: 0.507421 Dec 14 03:15:09.628578 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 35/68] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:15:09 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1407 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:15:09.876289 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-6c3240a7-0a8b-495c-9f13-daa8d8b59b16 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:09.878473 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-6c3240a7-0a8b-495c-9f13-daa8d8b59b16 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] [instance: d9988bfe-afac-40fa-ad73-2db57dadf545] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:09.898726 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-6c3240a7-0a8b-495c-9f13-daa8d8b59b16 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:09.899557 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-6c3240a7-0a8b-495c-9f13-daa8d8b59b16 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:09.902182 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-6c3240a7-0a8b-495c-9f13-daa8d8b59b16 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:09.903012 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-6c3240a7-0a8b-495c-9f13-daa8d8b59b16 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:10.154337 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-6c3240a7-0a8b-495c-9f13-daa8d8b59b16 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a8e0684f10464394e4f935d687cc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efcbf12d6654bc68690363892415b77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:10.166621 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-6c3240a7-0a8b-495c-9f13-daa8d8b59b16 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.43 "GET /compute/v2.1/servers/d9988bfe-afac-40fa-ad73-2db57dadf545" status: 200 len: 1315 microversion: 2.1 time: 0.291681 Dec 14 03:15:10.167629 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 34/69] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:15:09 2021] GET /compute/v2.1/servers/d9988bfe-afac-40fa-ad73-2db57dadf545 => generated 1315 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:15:10.246239 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-240f33d4-eec4-4875-b59c-3b87a7e27bdb tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:10.249190 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-240f33d4-eec4-4875-b59c-3b87a7e27bdb tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: c6283570-4ee2-47bc-b58a-fbfe57acbcde] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:10.268478 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-240f33d4-eec4-4875-b59c-3b87a7e27bdb tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:10.269361 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-240f33d4-eec4-4875-b59c-3b87a7e27bdb tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:10.270818 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-240f33d4-eec4-4875-b59c-3b87a7e27bdb tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:10.273241 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-240f33d4-eec4-4875-b59c-3b87a7e27bdb tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:10.466084 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-240f33d4-eec4-4875-b59c-3b87a7e27bdb tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:10.497914 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-e6ca283a-22a3-475b-a865-4445ffa9571b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:10.501425 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-e6ca283a-22a3-475b-a865-4445ffa9571b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:10.514517 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-e6ca283a-22a3-475b-a865-4445ffa9571b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:10.514981 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-e6ca283a-22a3-475b-a865-4445ffa9571b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:10.515818 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-e6ca283a-22a3-475b-a865-4445ffa9571b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:10.516259 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-e6ca283a-22a3-475b-a865-4445ffa9571b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:10.521454 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-240f33d4-eec4-4875-b59c-3b87a7e27bdb tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde" status: 200 len: 1322 microversion: 2.1 time: 0.287474 Dec 14 03:15:10.537358 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 36/70] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:15:10 2021] GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde => generated 1322 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:15:10.646166 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-1486b9d0-080a-41f2-9ddc-098ec3c33796 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:10.646890 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-1486b9d0-080a-41f2-9ddc-098ec3c33796 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:10.659393 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1486b9d0-080a-41f2-9ddc-098ec3c33796 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:10.659393 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1486b9d0-080a-41f2-9ddc-098ec3c33796 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:10.659393 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1486b9d0-080a-41f2-9ddc-098ec3c33796 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:10.663200 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1486b9d0-080a-41f2-9ddc-098ec3c33796 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:10.981016 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-e6ca283a-22a3-475b-a865-4445ffa9571b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107444106cda461dab7c403665d92613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:10.989535 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-e6ca283a-22a3-475b-a865-4445ffa9571b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364" status: 200 len: 1362 microversion: 2.1 time: 0.495636 Dec 14 03:15:10.990737 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 35/71] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:15:10 2021] GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364 => generated 1362 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 03:15:11.009711 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-1486b9d0-080a-41f2-9ddc-098ec3c33796 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:11.018986 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-1486b9d0-080a-41f2-9ddc-098ec3c33796 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:11.021431 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-1486b9d0-080a-41f2-9ddc-098ec3c33796 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:11.022539 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-1486b9d0-080a-41f2-9ddc-098ec3c33796 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1407 microversion: 2.20 time: 0.380910 Dec 14 03:15:11.033765 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 37/72] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:15:10 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1407 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 14 03:15:11.194915 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-5ceb6130-80e4-41df-96bc-35e5a81a92df tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:11.196517 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-5ceb6130-80e4-41df-96bc-35e5a81a92df tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] [instance: d9988bfe-afac-40fa-ad73-2db57dadf545] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:11.225166 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-5ceb6130-80e4-41df-96bc-35e5a81a92df tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:11.225804 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-5ceb6130-80e4-41df-96bc-35e5a81a92df tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:11.226806 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-5ceb6130-80e4-41df-96bc-35e5a81a92df tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:11.227833 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-5ceb6130-80e4-41df-96bc-35e5a81a92df tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:11.556898 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-5ceb6130-80e4-41df-96bc-35e5a81a92df tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a8e0684f10464394e4f935d687cc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efcbf12d6654bc68690363892415b77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:11.578684 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-5ceb6130-80e4-41df-96bc-35e5a81a92df tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.43 "GET /compute/v2.1/servers/d9988bfe-afac-40fa-ad73-2db57dadf545" status: 200 len: 1315 microversion: 2.1 time: 0.397815 Dec 14 03:15:11.585287 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 36/73] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:15:11 2021] GET /compute/v2.1/servers/d9988bfe-afac-40fa-ad73-2db57dadf545 => generated 1315 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:15:11.596008 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-5f4d0099-e2e4-4b2b-a595-2761f1ef4bd8 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:11.596952 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-5f4d0099-e2e4-4b2b-a595-2761f1ef4bd8 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: c6283570-4ee2-47bc-b58a-fbfe57acbcde] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:11.609830 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5f4d0099-e2e4-4b2b-a595-2761f1ef4bd8 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:11.610525 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5f4d0099-e2e4-4b2b-a595-2761f1ef4bd8 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:11.616861 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5f4d0099-e2e4-4b2b-a595-2761f1ef4bd8 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:11.617424 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5f4d0099-e2e4-4b2b-a595-2761f1ef4bd8 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:11.668775 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [req-31c83e7f-2ba0-42b8-8fd1-95993dced9c4 req-31a7fee1-7aa9-4052-bd5b-ff432b1b12c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd35b83c-0304-43fc-85ec-731c395d3364", "tag": "b1d9bd41-b159-47f7-8b8c-3145159e82db"}]} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:15:11.670798 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:15:11.670798 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: warnings.warn(msg) Dec 14 03:15:11.688636 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [req-31c83e7f-2ba0-42b8-8fd1-95993dced9c4 req-31a7fee1-7aa9-4052-bd5b-ff432b1b12c7 service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:11.689803 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [req-31c83e7f-2ba0-42b8-8fd1-95993dced9c4 req-31a7fee1-7aa9-4052-bd5b-ff432b1b12c7 service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:11.716708 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.compute.server_external_events [req-31c83e7f-2ba0-42b8-8fd1-95993dced9c4 req-31a7fee1-7aa9-4052-bd5b-ff432b1b12c7 service nova] Creating event network-changed:b1d9bd41-b159-47f7-8b8c-3145159e82db for instance fd35b83c-0304-43fc-85ec-731c395d3364 on hv-cinder-81803 Dec 14 03:15:11.726449 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [req-31c83e7f-2ba0-42b8-8fd1-95993dced9c4 req-31a7fee1-7aa9-4052-bd5b-ff432b1b12c7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061346 Dec 14 03:15:11.728038 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 37/74] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Dec 14 03:15:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:15:11.845206 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-5f4d0099-e2e4-4b2b-a595-2761f1ef4bd8 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:11.858903 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-5f4d0099-e2e4-4b2b-a595-2761f1ef4bd8 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde" status: 200 len: 1322 microversion: 2.1 time: 0.263505 Dec 14 03:15:11.859833 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 38/75] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:15:11 2021] GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde => generated 1322 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:15:12.006688 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-5f5aafcb-9ed1-4409-a363-1f0d2e20a1ca tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:12.007416 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-5f5aafcb-9ed1-4409-a363-1f0d2e20a1ca tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:12.013900 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-5f5aafcb-9ed1-4409-a363-1f0d2e20a1ca tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:12.014576 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-5f5aafcb-9ed1-4409-a363-1f0d2e20a1ca tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:12.015700 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-5f5aafcb-9ed1-4409-a363-1f0d2e20a1ca tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:12.016134 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-5f5aafcb-9ed1-4409-a363-1f0d2e20a1ca tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:12.041926 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-6c28c5de-00fe-4bc8-99e3-4645d69f33be tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:12.042534 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-6c28c5de-00fe-4bc8-99e3-4645d69f33be tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:12.052417 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6c28c5de-00fe-4bc8-99e3-4645d69f33be tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:12.053136 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6c28c5de-00fe-4bc8-99e3-4645d69f33be tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:12.053932 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6c28c5de-00fe-4bc8-99e3-4645d69f33be tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:12.061780 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6c28c5de-00fe-4bc8-99e3-4645d69f33be tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:12.263354 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-5f5aafcb-9ed1-4409-a363-1f0d2e20a1ca tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107444106cda461dab7c403665d92613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:12.276867 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-5f5aafcb-9ed1-4409-a363-1f0d2e20a1ca tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364" status: 200 len: 1362 microversion: 2.1 time: 0.274070 Dec 14 03:15:12.277680 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 38/76] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:15:12 2021] GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364 => generated 1362 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:15:12.303282 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-6c28c5de-00fe-4bc8-99e3-4645d69f33be tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:12.312455 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-6c28c5de-00fe-4bc8-99e3-4645d69f33be tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:12.314148 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-6c28c5de-00fe-4bc8-99e3-4645d69f33be tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:12.315501 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-6c28c5de-00fe-4bc8-99e3-4645d69f33be tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1407 microversion: 2.20 time: 0.277595 Dec 14 03:15:12.316078 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 39/77] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:15:12 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1407 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 14 03:15:12.596146 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-6fd6c5e4-d54a-4ff8-b12f-857115f42a20 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:12.597030 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-6fd6c5e4-d54a-4ff8-b12f-857115f42a20 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] [instance: d9988bfe-afac-40fa-ad73-2db57dadf545] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:12.604344 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-6fd6c5e4-d54a-4ff8-b12f-857115f42a20 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:12.605025 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-6fd6c5e4-d54a-4ff8-b12f-857115f42a20 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:12.619543 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-6fd6c5e4-d54a-4ff8-b12f-857115f42a20 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:12.620798 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-6fd6c5e4-d54a-4ff8-b12f-857115f42a20 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:12.816509 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-6fd6c5e4-d54a-4ff8-b12f-857115f42a20 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a8e0684f10464394e4f935d687cc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efcbf12d6654bc68690363892415b77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:12.824333 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-6fd6c5e4-d54a-4ff8-b12f-857115f42a20 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.43 "GET /compute/v2.1/servers/d9988bfe-afac-40fa-ad73-2db57dadf545" status: 200 len: 1315 microversion: 2.1 time: 0.231943 Dec 14 03:15:12.825105 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 39/78] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:15:12 2021] GET /compute/v2.1/servers/d9988bfe-afac-40fa-ad73-2db57dadf545 => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:15:12.880058 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-f29fcfd8-61a9-42fc-964d-2f423c519bd5 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:12.881239 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-f29fcfd8-61a9-42fc-964d-2f423c519bd5 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: c6283570-4ee2-47bc-b58a-fbfe57acbcde] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:12.889701 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f29fcfd8-61a9-42fc-964d-2f423c519bd5 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:12.890467 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f29fcfd8-61a9-42fc-964d-2f423c519bd5 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:12.891398 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f29fcfd8-61a9-42fc-964d-2f423c519bd5 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:12.892011 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f29fcfd8-61a9-42fc-964d-2f423c519bd5 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:13.049712 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-f29fcfd8-61a9-42fc-964d-2f423c519bd5 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:13.076783 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-f29fcfd8-61a9-42fc-964d-2f423c519bd5 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde" status: 200 len: 1322 microversion: 2.1 time: 0.200668 Dec 14 03:15:13.076783 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 40/79] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:15:12 2021] GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde => generated 1322 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 03:15:13.293404 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-09394824-7279-4472-9f70-972c113cd616 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:13.293989 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-09394824-7279-4472-9f70-972c113cd616 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:13.301953 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-09394824-7279-4472-9f70-972c113cd616 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:13.302407 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-09394824-7279-4472-9f70-972c113cd616 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:13.303246 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-09394824-7279-4472-9f70-972c113cd616 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:13.303690 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-09394824-7279-4472-9f70-972c113cd616 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:13.334929 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-ede52bfe-6eac-4926-8ab4-8712d1309628 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:13.335864 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-ede52bfe-6eac-4926-8ab4-8712d1309628 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:13.342638 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ede52bfe-6eac-4926-8ab4-8712d1309628 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:13.343114 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ede52bfe-6eac-4926-8ab4-8712d1309628 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:13.344161 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ede52bfe-6eac-4926-8ab4-8712d1309628 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:13.344590 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ede52bfe-6eac-4926-8ab4-8712d1309628 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:13.525488 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-09394824-7279-4472-9f70-972c113cd616 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107444106cda461dab7c403665d92613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:13.537147 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-09394824-7279-4472-9f70-972c113cd616 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364" status: 200 len: 1362 microversion: 2.1 time: 0.247234 Dec 14 03:15:13.537801 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 40/80] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:15:13 2021] GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364 => generated 1362 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:15:13.538198 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-ede52bfe-6eac-4926-8ab4-8712d1309628 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:13.549783 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-ede52bfe-6eac-4926-8ab4-8712d1309628 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:13.551887 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-ede52bfe-6eac-4926-8ab4-8712d1309628 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:13.553593 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-ede52bfe-6eac-4926-8ab4-8712d1309628 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1407 microversion: 2.20 time: 0.223551 Dec 14 03:15:13.554139 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 41/81] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:15:13 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1407 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 14 03:15:13.841422 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-6cf75ddf-e68e-4537-94ec-ed2b6d2cff46 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:13.842041 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-6cf75ddf-e68e-4537-94ec-ed2b6d2cff46 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] [instance: d9988bfe-afac-40fa-ad73-2db57dadf545] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:13.849000 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-6cf75ddf-e68e-4537-94ec-ed2b6d2cff46 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:13.849806 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-6cf75ddf-e68e-4537-94ec-ed2b6d2cff46 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:13.850920 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-6cf75ddf-e68e-4537-94ec-ed2b6d2cff46 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:13.851531 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-6cf75ddf-e68e-4537-94ec-ed2b6d2cff46 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:13.993161 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-6cf75ddf-e68e-4537-94ec-ed2b6d2cff46 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a8e0684f10464394e4f935d687cc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efcbf12d6654bc68690363892415b77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:14.000452 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-6cf75ddf-e68e-4537-94ec-ed2b6d2cff46 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.43 "GET /compute/v2.1/servers/d9988bfe-afac-40fa-ad73-2db57dadf545" status: 200 len: 1315 microversion: 2.1 time: 0.162674 Dec 14 03:15:14.001165 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 41/82] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:15:13 2021] GET /compute/v2.1/servers/d9988bfe-afac-40fa-ad73-2db57dadf545 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:15:14.092978 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-6fc02257-d84e-40ad-ba35-132feb69a851 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:14.093590 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-6fc02257-d84e-40ad-ba35-132feb69a851 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: c6283570-4ee2-47bc-b58a-fbfe57acbcde] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:14.099961 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6fc02257-d84e-40ad-ba35-132feb69a851 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:14.100411 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6fc02257-d84e-40ad-ba35-132feb69a851 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:14.101192 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6fc02257-d84e-40ad-ba35-132feb69a851 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:14.101629 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6fc02257-d84e-40ad-ba35-132feb69a851 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:14.232541 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-6fc02257-d84e-40ad-ba35-132feb69a851 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:14.240640 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-6fc02257-d84e-40ad-ba35-132feb69a851 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde" status: 200 len: 1322 microversion: 2.1 time: 0.151287 Dec 14 03:15:14.241207 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 42/83] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:15:14 2021] GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:15:14.520800 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [req-51818fa1-f47d-4aad-b2e3-a471676c0490 req-35d2476e-b365-4390-b054-65ff749352d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4687b559-c95a-4b82-a076-a7468c10ebef", "name": "network-vif-plugged", "status": "completed", "tag": "9d0f1802-5b85-4dd7-847f-3cdd0b182adf"}]} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:15:14.523533 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:15:14.523533 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: warnings.warn(msg) Dec 14 03:15:14.531609 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [req-51818fa1-f47d-4aad-b2e3-a471676c0490 req-35d2476e-b365-4390-b054-65ff749352d4 service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:14.531609 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [req-51818fa1-f47d-4aad-b2e3-a471676c0490 req-35d2476e-b365-4390-b054-65ff749352d4 service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:14.543982 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.compute.server_external_events [req-51818fa1-f47d-4aad-b2e3-a471676c0490 req-35d2476e-b365-4390-b054-65ff749352d4 service nova] Creating event network-vif-plugged:9d0f1802-5b85-4dd7-847f-3cdd0b182adf for instance 4687b559-c95a-4b82-a076-a7468c10ebef on hv-cinder-81803 Dec 14 03:15:14.549432 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [req-51818fa1-f47d-4aad-b2e3-a471676c0490 req-35d2476e-b365-4390-b054-65ff749352d4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034056 Dec 14 03:15:14.550192 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 42/84] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Dec 14 03:15:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:15:14.553631 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-bd9bf0ee-cafd-4091-bc65-d0ecf05ef4ba tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:14.554250 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-bd9bf0ee-cafd-4091-bc65-d0ecf05ef4ba tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:14.560043 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-bd9bf0ee-cafd-4091-bc65-d0ecf05ef4ba tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:14.560667 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-bd9bf0ee-cafd-4091-bc65-d0ecf05ef4ba tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:14.561510 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-bd9bf0ee-cafd-4091-bc65-d0ecf05ef4ba tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:14.561905 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-bd9bf0ee-cafd-4091-bc65-d0ecf05ef4ba tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:14.577437 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-f29c4427-a38c-4b63-a135-6c6c10f0550a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:14.579127 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-f29c4427-a38c-4b63-a135-6c6c10f0550a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:14.586473 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-f29c4427-a38c-4b63-a135-6c6c10f0550a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:14.587232 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-f29c4427-a38c-4b63-a135-6c6c10f0550a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:14.591290 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-f29c4427-a38c-4b63-a135-6c6c10f0550a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:14.593190 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-f29c4427-a38c-4b63-a135-6c6c10f0550a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:14.747733 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-bd9bf0ee-cafd-4091-bc65-d0ecf05ef4ba tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107444106cda461dab7c403665d92613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:14.757120 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-bd9bf0ee-cafd-4091-bc65-d0ecf05ef4ba tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364" status: 200 len: 1362 microversion: 2.1 time: 0.207120 Dec 14 03:15:14.759492 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 43/85] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:15:14 2021] GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364 => generated 1362 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 03:15:14.811278 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-f29c4427-a38c-4b63-a135-6c6c10f0550a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:14.821803 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-f29c4427-a38c-4b63-a135-6c6c10f0550a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:14.823524 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-f29c4427-a38c-4b63-a135-6c6c10f0550a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:14.824880 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-f29c4427-a38c-4b63-a135-6c6c10f0550a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1407 microversion: 2.20 time: 0.251485 Dec 14 03:15:14.825352 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 43/86] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:15:14 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1407 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:15:15.017318 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-66b0fee3-5c05-4ba1-a6d2-4ff1bd81f65e tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:15.017942 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-66b0fee3-5c05-4ba1-a6d2-4ff1bd81f65e tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] [instance: d9988bfe-afac-40fa-ad73-2db57dadf545] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:15.024359 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-66b0fee3-5c05-4ba1-a6d2-4ff1bd81f65e tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:15.024812 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-66b0fee3-5c05-4ba1-a6d2-4ff1bd81f65e tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:15.025595 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-66b0fee3-5c05-4ba1-a6d2-4ff1bd81f65e tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:15.026031 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-66b0fee3-5c05-4ba1-a6d2-4ff1bd81f65e tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:15.156549 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-66b0fee3-5c05-4ba1-a6d2-4ff1bd81f65e tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a8e0684f10464394e4f935d687cc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efcbf12d6654bc68690363892415b77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:15.163758 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-66b0fee3-5c05-4ba1-a6d2-4ff1bd81f65e tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.43 "GET /compute/v2.1/servers/d9988bfe-afac-40fa-ad73-2db57dadf545" status: 200 len: 1315 microversion: 2.1 time: 0.149972 Dec 14 03:15:15.164514 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 44/87] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:15:15 2021] GET /compute/v2.1/servers/d9988bfe-afac-40fa-ad73-2db57dadf545 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:15:15.257393 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-a16b223e-5dfd-4231-926b-feafea632113 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:15.258007 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-a16b223e-5dfd-4231-926b-feafea632113 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: c6283570-4ee2-47bc-b58a-fbfe57acbcde] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:15.263789 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a16b223e-5dfd-4231-926b-feafea632113 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:15.264240 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a16b223e-5dfd-4231-926b-feafea632113 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:15.265009 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a16b223e-5dfd-4231-926b-feafea632113 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:15.265441 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a16b223e-5dfd-4231-926b-feafea632113 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:15.400636 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-a16b223e-5dfd-4231-926b-feafea632113 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:15.407941 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-a16b223e-5dfd-4231-926b-feafea632113 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde" status: 200 len: 1322 microversion: 2.1 time: 0.154683 Dec 14 03:15:15.408508 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 44/88] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:15:15 2021] GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:15:15.774514 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-d2f225d8-5759-497c-81bb-b4ffe5054ccf tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:15.775504 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-d2f225d8-5759-497c-81bb-b4ffe5054ccf tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:15.783806 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d2f225d8-5759-497c-81bb-b4ffe5054ccf tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:15.784505 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d2f225d8-5759-497c-81bb-b4ffe5054ccf tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:15.786151 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d2f225d8-5759-497c-81bb-b4ffe5054ccf tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:15.786799 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d2f225d8-5759-497c-81bb-b4ffe5054ccf tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:15.843464 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-b96d5a1f-d769-4767-891b-2b84f805ce65 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:15.846240 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-b96d5a1f-d769-4767-891b-2b84f805ce65 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:15.853172 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b96d5a1f-d769-4767-891b-2b84f805ce65 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:15.853784 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b96d5a1f-d769-4767-891b-2b84f805ce65 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:15.854579 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b96d5a1f-d769-4767-891b-2b84f805ce65 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:15.855021 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b96d5a1f-d769-4767-891b-2b84f805ce65 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:15.963650 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-d2f225d8-5759-497c-81bb-b4ffe5054ccf tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107444106cda461dab7c403665d92613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:15.971557 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-d2f225d8-5759-497c-81bb-b4ffe5054ccf tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364" status: 200 len: 1362 microversion: 2.1 time: 0.201696 Dec 14 03:15:15.972514 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 45/89] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:15:15 2021] GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364 => generated 1362 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:15:16.067737 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-b96d5a1f-d769-4767-891b-2b84f805ce65 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:16.073488 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-b96d5a1f-d769-4767-891b-2b84f805ce65 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:16.074976 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-b96d5a1f-d769-4767-891b-2b84f805ce65 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:16.076108 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-b96d5a1f-d769-4767-891b-2b84f805ce65 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1407 microversion: 2.20 time: 0.236774 Dec 14 03:15:16.076656 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 45/90] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:15:15 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1407 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 14 03:15:16.181525 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-987a474a-2081-41da-8876-8b8a9895a292 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:16.182133 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-987a474a-2081-41da-8876-8b8a9895a292 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] [instance: d9988bfe-afac-40fa-ad73-2db57dadf545] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:16.187906 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-987a474a-2081-41da-8876-8b8a9895a292 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:16.188349 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-987a474a-2081-41da-8876-8b8a9895a292 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:16.189138 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-987a474a-2081-41da-8876-8b8a9895a292 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:16.189563 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-987a474a-2081-41da-8876-8b8a9895a292 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:16.396230 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-987a474a-2081-41da-8876-8b8a9895a292 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a8e0684f10464394e4f935d687cc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efcbf12d6654bc68690363892415b77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:16.404649 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-987a474a-2081-41da-8876-8b8a9895a292 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.43 "GET /compute/v2.1/servers/d9988bfe-afac-40fa-ad73-2db57dadf545" status: 200 len: 1315 microversion: 2.1 time: 0.226742 Dec 14 03:15:16.405823 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 46/91] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:15:16 2021] GET /compute/v2.1/servers/d9988bfe-afac-40fa-ad73-2db57dadf545 => generated 1315 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:15:16.424608 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-96e848ae-3f35-4cda-9d5f-c49f9be3f147 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:16.426203 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-96e848ae-3f35-4cda-9d5f-c49f9be3f147 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: c6283570-4ee2-47bc-b58a-fbfe57acbcde] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:16.433242 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-96e848ae-3f35-4cda-9d5f-c49f9be3f147 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:16.433757 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-96e848ae-3f35-4cda-9d5f-c49f9be3f147 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:16.434712 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-96e848ae-3f35-4cda-9d5f-c49f9be3f147 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:16.435448 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-96e848ae-3f35-4cda-9d5f-c49f9be3f147 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:16.576491 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [req-4c5f7c7d-c120-4019-97c2-3fa2b468ee36 req-0533ca8f-c4da-4e1a-934f-235c193c8c9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6283570-4ee2-47bc-b58a-fbfe57acbcde", "name": "network-vif-plugged", "status": "completed", "tag": "4b8834a4-3f18-49ea-b3a2-4053d903f624"}]} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:15:16.578063 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:15:16.578063 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: warnings.warn(msg) Dec 14 03:15:16.585733 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-4c5f7c7d-c120-4019-97c2-3fa2b468ee36 req-0533ca8f-c4da-4e1a-934f-235c193c8c9f service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:16.586173 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-4c5f7c7d-c120-4019-97c2-3fa2b468ee36 req-0533ca8f-c4da-4e1a-934f-235c193c8c9f service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:16.597817 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.compute.server_external_events [req-4c5f7c7d-c120-4019-97c2-3fa2b468ee36 req-0533ca8f-c4da-4e1a-934f-235c193c8c9f service nova] Creating event network-vif-plugged:4b8834a4-3f18-49ea-b3a2-4053d903f624 for instance c6283570-4ee2-47bc-b58a-fbfe57acbcde on hv-cinder-81803 Dec 14 03:15:16.603243 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [req-4c5f7c7d-c120-4019-97c2-3fa2b468ee36 req-0533ca8f-c4da-4e1a-934f-235c193c8c9f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030343 Dec 14 03:15:16.604235 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 47/92] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Dec 14 03:15:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:15:16.758566 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-96e848ae-3f35-4cda-9d5f-c49f9be3f147 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:16.765901 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-96e848ae-3f35-4cda-9d5f-c49f9be3f147 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde" status: 200 len: 1322 microversion: 2.1 time: 0.344914 Dec 14 03:15:16.766457 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 46/93] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:15:16 2021] GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde => generated 1322 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:15:16.988691 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-6b0d8092-b989-4a2c-9662-cc6784997356 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:16.989592 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-6b0d8092-b989-4a2c-9662-cc6784997356 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:16.995887 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6b0d8092-b989-4a2c-9662-cc6784997356 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:16.996663 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6b0d8092-b989-4a2c-9662-cc6784997356 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:16.997611 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6b0d8092-b989-4a2c-9662-cc6784997356 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:16.998200 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6b0d8092-b989-4a2c-9662-cc6784997356 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:17.094342 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-5e75ebdd-f2d6-4b29-89d8-ff571041fcad tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:17.095783 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-5e75ebdd-f2d6-4b29-89d8-ff571041fcad tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:17.108233 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-5e75ebdd-f2d6-4b29-89d8-ff571041fcad tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:17.108867 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-5e75ebdd-f2d6-4b29-89d8-ff571041fcad tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:17.109810 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-5e75ebdd-f2d6-4b29-89d8-ff571041fcad tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:17.110383 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-5e75ebdd-f2d6-4b29-89d8-ff571041fcad tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:17.359580 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-6b0d8092-b989-4a2c-9662-cc6784997356 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107444106cda461dab7c403665d92613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:17.368627 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-6b0d8092-b989-4a2c-9662-cc6784997356 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364" status: 200 len: 1362 microversion: 2.1 time: 0.384029 Dec 14 03:15:17.379560 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 48/94] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:15:16 2021] GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364 => generated 1362 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:15:17.402260 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-5e75ebdd-f2d6-4b29-89d8-ff571041fcad tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:17.410264 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-5e75ebdd-f2d6-4b29-89d8-ff571041fcad tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:17.411871 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-5e75ebdd-f2d6-4b29-89d8-ff571041fcad tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:17.412962 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-5e75ebdd-f2d6-4b29-89d8-ff571041fcad tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1407 microversion: 2.20 time: 0.322629 Dec 14 03:15:17.413508 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 47/95] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:15:17 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1407 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:15:17.422191 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-819d6925-afba-454d-8cbd-cb9100d9f8d7 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:17.422883 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-819d6925-afba-454d-8cbd-cb9100d9f8d7 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] [instance: d9988bfe-afac-40fa-ad73-2db57dadf545] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:17.428760 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-819d6925-afba-454d-8cbd-cb9100d9f8d7 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:17.429217 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-819d6925-afba-454d-8cbd-cb9100d9f8d7 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:17.429993 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-819d6925-afba-454d-8cbd-cb9100d9f8d7 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:17.430426 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-819d6925-afba-454d-8cbd-cb9100d9f8d7 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:17.565044 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-819d6925-afba-454d-8cbd-cb9100d9f8d7 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a8e0684f10464394e4f935d687cc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efcbf12d6654bc68690363892415b77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:17.572671 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-819d6925-afba-454d-8cbd-cb9100d9f8d7 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.43 "GET /compute/v2.1/servers/d9988bfe-afac-40fa-ad73-2db57dadf545" status: 200 len: 1315 microversion: 2.1 time: 0.154974 Dec 14 03:15:17.573229 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 49/96] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:15:17 2021] GET /compute/v2.1/servers/d9988bfe-afac-40fa-ad73-2db57dadf545 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:15:17.782883 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-cd19e2eb-76bd-4274-b2d2-803515b8f033 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:17.783530 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-cd19e2eb-76bd-4274-b2d2-803515b8f033 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: c6283570-4ee2-47bc-b58a-fbfe57acbcde] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:17.789886 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-cd19e2eb-76bd-4274-b2d2-803515b8f033 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:17.790353 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-cd19e2eb-76bd-4274-b2d2-803515b8f033 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:17.791132 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-cd19e2eb-76bd-4274-b2d2-803515b8f033 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:17.791566 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-cd19e2eb-76bd-4274-b2d2-803515b8f033 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:17.923400 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-cd19e2eb-76bd-4274-b2d2-803515b8f033 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:17.934684 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-cd19e2eb-76bd-4274-b2d2-803515b8f033 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde" status: 200 len: 1322 microversion: 2.1 time: 0.155252 Dec 14 03:15:17.935296 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 48/97] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:15:17 2021] GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:15:18.248539 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-e6af7274-6397-49fa-8cde-f7cf8ac79a7a tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1041445254", "imageRef": "4fff76a9-6620-4bda-b1ec-2cd3719c946a", "flavorRef": "452"}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:15:18.313192 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.network.neutron [None req-e6af7274-6397-49fa-8cde-f7cf8ac79a7a tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] validate_networks() for None {{(pid=116072) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 14 03:15:18.396457 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-0dbbdda5-b1a9-498a-a936-bd3d439f4875 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:18.397235 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-0dbbdda5-b1a9-498a-a936-bd3d439f4875 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:18.404406 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-0dbbdda5-b1a9-498a-a936-bd3d439f4875 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:18.405447 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-0dbbdda5-b1a9-498a-a936-bd3d439f4875 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:18.406610 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-0dbbdda5-b1a9-498a-a936-bd3d439f4875 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:18.407534 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-0dbbdda5-b1a9-498a-a936-bd3d439f4875 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:18.713311 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-0dbbdda5-b1a9-498a-a936-bd3d439f4875 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107444106cda461dab7c403665d92613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:18.724817 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-0dbbdda5-b1a9-498a-a936-bd3d439f4875 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364" status: 200 len: 1362 microversion: 2.1 time: 0.339597 Dec 14 03:15:18.732684 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 49/98] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:15:18 2021] GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364 => generated 1362 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 03:15:18.737377 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-005f1e71-f427-4de8-8ac8-c631d89ddac2 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:18.738037 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-005f1e71-f427-4de8-8ac8-c631d89ddac2 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:18.745201 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-005f1e71-f427-4de8-8ac8-c631d89ddac2 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:18.746159 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-005f1e71-f427-4de8-8ac8-c631d89ddac2 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:18.747475 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-005f1e71-f427-4de8-8ac8-c631d89ddac2 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:18.747918 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-005f1e71-f427-4de8-8ac8-c631d89ddac2 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:18.751603 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-e6af7274-6397-49fa-8cde-f7cf8ac79a7a tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Flavor limits 0:0:0 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 14 03:15:18.752067 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-e6af7274-6397-49fa-8cde-f7cf8ac79a7a tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Image limits 0:0:0 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 14 03:15:18.752468 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-e6af7274-6397-49fa-8cde-f7cf8ac79a7a tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Flavor pref 0:0:0 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 14 03:15:18.752870 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-e6af7274-6397-49fa-8cde-f7cf8ac79a7a tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Image pref 0:0:0 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 14 03:15:18.753331 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-e6af7274-6397-49fa-8cde-f7cf8ac79a7a tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 14 03:15:18.768558 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e6af7274-6397-49fa-8cde-f7cf8ac79a7a tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:18.769255 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e6af7274-6397-49fa-8cde-f7cf8ac79a7a tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:18.770651 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e6af7274-6397-49fa-8cde-f7cf8ac79a7a tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:18.771148 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e6af7274-6397-49fa-8cde-f7cf8ac79a7a tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:18.788686 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.quota [None req-e6af7274-6397-49fa-8cde-f7cf8ac79a7a tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Getting quotas for project 722b58145d434e1181ebd90e63eb1255. Resources: {'cores', 'instances', 'ram'} {{(pid=116072) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 03:15:18.792922 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.quota [None req-e6af7274-6397-49fa-8cde-f7cf8ac79a7a tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Getting quotas for user e8f5b824c4204f5da272b60d907bb2a6 and project 722b58145d434e1181ebd90e63eb1255. Resources: {'cores', 'instances', 'ram'} {{(pid=116072) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 03:15:18.805266 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-e6af7274-6397-49fa-8cde-f7cf8ac79a7a tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Going to run 1 instances... {{(pid=116072) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 14 03:15:18.808780 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-e6af7274-6397-49fa-8cde-f7cf8ac79a7a tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] [instance: ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4fff76a9-6620-4bda-b1ec-2cd3719c946a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 14 03:15:18.861188 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-e6af7274-6397-49fa-8cde-f7cf8ac79a7a tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.618704 Dec 14 03:15:18.862611 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 50/99] 10.222.0.43 () {60 vars in 1146 bytes} [Tue Dec 14 03:15:18 2021] POST /compute/v2.1/servers => generated 380 bytes in 621 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 14 03:15:18.896749 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-b7dbf97f-333b-4308-91f6-e885afdb59db tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:18.897388 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-b7dbf97f-333b-4308-91f6-e885afdb59db tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] [instance: d9988bfe-afac-40fa-ad73-2db57dadf545] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:18.904112 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b7dbf97f-333b-4308-91f6-e885afdb59db tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:18.904792 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b7dbf97f-333b-4308-91f6-e885afdb59db tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:18.905894 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b7dbf97f-333b-4308-91f6-e885afdb59db tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:18.906468 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b7dbf97f-333b-4308-91f6-e885afdb59db tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:18.915929 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-005f1e71-f427-4de8-8ac8-c631d89ddac2 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:18.925241 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-005f1e71-f427-4de8-8ac8-c631d89ddac2 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:18.927518 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-005f1e71-f427-4de8-8ac8-c631d89ddac2 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:18.929395 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-005f1e71-f427-4de8-8ac8-c631d89ddac2 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1407 microversion: 2.20 time: 0.195695 Dec 14 03:15:18.930097 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 50/100] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:15:18 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1407 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:15:18.939591 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-d2201b6d-f6e8-443f-b186-607f73ab94da tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:18.939591 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-d2201b6d-f6e8-443f-b186-607f73ab94da tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] [instance: ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:19.005659 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-d2201b6d-f6e8-443f-b186-607f73ab94da tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f5b824c4204f5da272b60d907bb2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722b58145d434e1181ebd90e63eb1255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:19.014426 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-d2201b6d-f6e8-443f-b186-607f73ab94da tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] 10.222.0.43 "GET /compute/v2.1/servers/ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d" status: 200 len: 1215 microversion: 2.1 time: 0.082264 Dec 14 03:15:19.016120 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 51/101] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:15:18 2021] GET /compute/v2.1/servers/ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d => generated 1215 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:15:19.023712 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-21464577-15c4-4290-a7a6-af9175bf4685 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:19.036900 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-21464577-15c4-4290-a7a6-af9175bf4685 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: c6283570-4ee2-47bc-b58a-fbfe57acbcde] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:19.050934 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-21464577-15c4-4290-a7a6-af9175bf4685 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:19.054395 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-21464577-15c4-4290-a7a6-af9175bf4685 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:19.058126 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-21464577-15c4-4290-a7a6-af9175bf4685 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:19.059198 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-21464577-15c4-4290-a7a6-af9175bf4685 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:19.190300 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-b7dbf97f-333b-4308-91f6-e885afdb59db tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a8e0684f10464394e4f935d687cc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efcbf12d6654bc68690363892415b77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:19.199097 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-b7dbf97f-333b-4308-91f6-e885afdb59db tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.43 "GET /compute/v2.1/servers/d9988bfe-afac-40fa-ad73-2db57dadf545" status: 200 len: 1501 microversion: 2.1 time: 0.333087 Dec 14 03:15:19.200248 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 51/102] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:15:18 2021] GET /compute/v2.1/servers/d9988bfe-afac-40fa-ad73-2db57dadf545 => generated 1501 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:15:19.306169 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-21464577-15c4-4290-a7a6-af9175bf4685 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:19.315838 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-21464577-15c4-4290-a7a6-af9175bf4685 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde" status: 200 len: 1322 microversion: 2.1 time: 0.298469 Dec 14 03:15:19.317853 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 52/103] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:15:19 2021] GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde => generated 1322 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:15:19.743612 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-561ba540-a25d-4739-b803-4842e9cbf1f8 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:19.743612 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-561ba540-a25d-4739-b803-4842e9cbf1f8 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:19.748433 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-561ba540-a25d-4739-b803-4842e9cbf1f8 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:19.749019 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-561ba540-a25d-4739-b803-4842e9cbf1f8 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:19.760460 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-561ba540-a25d-4739-b803-4842e9cbf1f8 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:19.761872 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-561ba540-a25d-4739-b803-4842e9cbf1f8 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:19.949085 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-ff65872f-2654-4bba-89a7-0ec8035ce060 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:19.950821 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-ff65872f-2654-4bba-89a7-0ec8035ce060 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:19.961808 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ff65872f-2654-4bba-89a7-0ec8035ce060 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:19.964461 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ff65872f-2654-4bba-89a7-0ec8035ce060 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:19.965860 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ff65872f-2654-4bba-89a7-0ec8035ce060 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:19.968225 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ff65872f-2654-4bba-89a7-0ec8035ce060 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:20.013459 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-561ba540-a25d-4739-b803-4842e9cbf1f8 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107444106cda461dab7c403665d92613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:20.024685 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-561ba540-a25d-4739-b803-4842e9cbf1f8 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364" status: 200 len: 1362 microversion: 2.1 time: 0.288648 Dec 14 03:15:20.026286 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 52/104] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:15:19 2021] GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364 => generated 1362 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:15:20.040563 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-a0a2141f-3ae2-42d6-9abb-bf7eb92b1246 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:20.041596 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-a0a2141f-3ae2-42d6-9abb-bf7eb92b1246 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] [instance: ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:20.049172 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a0a2141f-3ae2-42d6-9abb-bf7eb92b1246 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:20.049985 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a0a2141f-3ae2-42d6-9abb-bf7eb92b1246 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:20.051953 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a0a2141f-3ae2-42d6-9abb-bf7eb92b1246 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:20.052727 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a0a2141f-3ae2-42d6-9abb-bf7eb92b1246 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:20.165048 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-a0a2141f-3ae2-42d6-9abb-bf7eb92b1246 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f5b824c4204f5da272b60d907bb2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722b58145d434e1181ebd90e63eb1255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:20.174285 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-a0a2141f-3ae2-42d6-9abb-bf7eb92b1246 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] 10.222.0.43 "GET /compute/v2.1/servers/ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d" status: 200 len: 1267 microversion: 2.1 time: 0.143274 Dec 14 03:15:20.175104 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 53/105] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:15:20 2021] GET /compute/v2.1/servers/ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d => generated 1267 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:15:20.233574 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-ff65872f-2654-4bba-89a7-0ec8035ce060 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:20.242185 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-ff65872f-2654-4bba-89a7-0ec8035ce060 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:20.243714 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-ff65872f-2654-4bba-89a7-0ec8035ce060 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:20.245136 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-ff65872f-2654-4bba-89a7-0ec8035ce060 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1407 microversion: 2.20 time: 0.301503 Dec 14 03:15:20.257216 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 53/106] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:15:19 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1407 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:15:20.342882 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-4883d6bc-427a-46ff-8a32-baec1e56117e tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:20.343707 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-4883d6bc-427a-46ff-8a32-baec1e56117e tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: c6283570-4ee2-47bc-b58a-fbfe57acbcde] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:20.351375 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4883d6bc-427a-46ff-8a32-baec1e56117e tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:20.351829 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4883d6bc-427a-46ff-8a32-baec1e56117e tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:20.352800 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4883d6bc-427a-46ff-8a32-baec1e56117e tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:20.353610 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4883d6bc-427a-46ff-8a32-baec1e56117e tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:20.554232 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-4883d6bc-427a-46ff-8a32-baec1e56117e tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:20.561590 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-4883d6bc-427a-46ff-8a32-baec1e56117e tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde" status: 200 len: 1516 microversion: 2.1 time: 0.231458 Dec 14 03:15:20.562170 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 54/107] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:15:20 2021] GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde => generated 1516 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:15:20.579389 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-39081ef9-4dcd-4bcb-9b1c-bdd62baab990 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:15:20.580698 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-39081ef9-4dcd-4bcb-9b1c-bdd62baab990 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: c6283570-4ee2-47bc-b58a-fbfe57acbcde] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:20.595652 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-39081ef9-4dcd-4bcb-9b1c-bdd62baab990 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:20.596465 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-39081ef9-4dcd-4bcb-9b1c-bdd62baab990 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:20.597854 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-39081ef9-4dcd-4bcb-9b1c-bdd62baab990 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:20.598525 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-39081ef9-4dcd-4bcb-9b1c-bdd62baab990 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:20.620312 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-dc0fad24-e60a-4a4d-8f61-c0b760dd7253 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4a975fa3-3cba-40c5-947d-824dd766e901"}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:15:20.621866 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-dc0fad24-e60a-4a4d-8f61-c0b760dd7253 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] [instance: d9988bfe-afac-40fa-ad73-2db57dadf545] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:20.628151 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-dc0fad24-e60a-4a4d-8f61-c0b760dd7253 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:20.628838 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-dc0fad24-e60a-4a4d-8f61-c0b760dd7253 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:20.630387 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-dc0fad24-e60a-4a4d-8f61-c0b760dd7253 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:20.631002 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-dc0fad24-e60a-4a4d-8f61-c0b760dd7253 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:20.685735 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.objects.instance [None req-39081ef9-4dcd-4bcb-9b1c-bdd62baab990 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lazy-loading 'flavor' on Instance uuid c6283570-4ee2-47bc-b58a-fbfe57acbcde {{(pid=116071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 14 03:15:20.832489 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-39081ef9-4dcd-4bcb-9b1c-bdd62baab990 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "POST /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde/action" status: 200 len: 32 microversion: 2.1 time: 0.255688 Dec 14 03:15:20.837518 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 54/108] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:15:20 2021] POST /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde/action => generated 32 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 14 03:15:20.856350 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-d74ddbea-5107-4c43-9aac-ed676344d293 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:20.857747 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-d74ddbea-5107-4c43-9aac-ed676344d293 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: c6283570-4ee2-47bc-b58a-fbfe57acbcde] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:20.867353 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-d74ddbea-5107-4c43-9aac-ed676344d293 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:20.867901 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-d74ddbea-5107-4c43-9aac-ed676344d293 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:20.868776 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-d74ddbea-5107-4c43-9aac-ed676344d293 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:20.869955 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-d74ddbea-5107-4c43-9aac-ed676344d293 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:21.129930 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-d74ddbea-5107-4c43-9aac-ed676344d293 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:21.141086 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-d74ddbea-5107-4c43-9aac-ed676344d293 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde" status: 200 len: 1522 microversion: 2.1 time: 0.302023 Dec 14 03:15:21.141281 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-dc0fad24-e60a-4a4d-8f61-c0b760dd7253 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.43 "POST /compute/v2.1/servers/d9988bfe-afac-40fa-ad73-2db57dadf545/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.524917 Dec 14 03:15:21.147690 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 55/109] 10.222.0.43 () {60 vars in 1322 bytes} [Tue Dec 14 03:15:20 2021] POST /compute/v2.1/servers/d9988bfe-afac-40fa-ad73-2db57dadf545/os-volume_attachments => generated 194 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:15:21.154574 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 55/110] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:15:20 2021] GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde => generated 1522 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:15:21.166608 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-d66336a7-f9f8-4455-aba3-26c6a45b8306 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:21.167500 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-d66336a7-f9f8-4455-aba3-26c6a45b8306 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:21.187211 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d66336a7-f9f8-4455-aba3-26c6a45b8306 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:21.187962 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d66336a7-f9f8-4455-aba3-26c6a45b8306 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:21.189033 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d66336a7-f9f8-4455-aba3-26c6a45b8306 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:21.189678 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d66336a7-f9f8-4455-aba3-26c6a45b8306 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:21.192728 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-fbde387d-8c10-47a6-bdbe-398687f7b551 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:21.193973 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-fbde387d-8c10-47a6-bdbe-398687f7b551 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] [instance: ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:21.200887 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-fbde387d-8c10-47a6-bdbe-398687f7b551 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:21.211911 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-fbde387d-8c10-47a6-bdbe-398687f7b551 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:21.212760 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-fbde387d-8c10-47a6-bdbe-398687f7b551 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:21.218199 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-fbde387d-8c10-47a6-bdbe-398687f7b551 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:21.375581 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-fbde387d-8c10-47a6-bdbe-398687f7b551 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f5b824c4204f5da272b60d907bb2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722b58145d434e1181ebd90e63eb1255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:21.385161 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-fbde387d-8c10-47a6-bdbe-398687f7b551 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] 10.222.0.43 "GET /compute/v2.1/servers/ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d" status: 200 len: 1273 microversion: 2.1 time: 0.195927 Dec 14 03:15:21.386967 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 56/111] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:15:21 2021] GET /compute/v2.1/servers/ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d => generated 1273 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:15:21.402711 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-da4ee8d9-1eda-4ee0-808c-757dbb45ea29 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:21.404455 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-da4ee8d9-1eda-4ee0-808c-757dbb45ea29 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:21.422122 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-da4ee8d9-1eda-4ee0-808c-757dbb45ea29 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:21.426862 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-da4ee8d9-1eda-4ee0-808c-757dbb45ea29 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:21.427723 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-da4ee8d9-1eda-4ee0-808c-757dbb45ea29 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:21.428363 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-da4ee8d9-1eda-4ee0-808c-757dbb45ea29 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:21.810765 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-d66336a7-f9f8-4455-aba3-26c6a45b8306 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107444106cda461dab7c403665d92613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:21.823999 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-d66336a7-f9f8-4455-aba3-26c6a45b8306 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364" status: 200 len: 1362 microversion: 2.1 time: 0.674986 Dec 14 03:15:21.825155 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 56/112] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:15:21 2021] GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364 => generated 1362 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:15:22.011331 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-da4ee8d9-1eda-4ee0-808c-757dbb45ea29 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:22.025835 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-da4ee8d9-1eda-4ee0-808c-757dbb45ea29 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:22.029160 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-da4ee8d9-1eda-4ee0-808c-757dbb45ea29 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:22.030313 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-da4ee8d9-1eda-4ee0-808c-757dbb45ea29 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1407 microversion: 2.20 time: 0.641440 Dec 14 03:15:22.030873 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 57/113] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:15:21 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1407 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:15:22.172076 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-5ebbd955-0431-40fc-8380-ffafb06f2958 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:22.173159 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-5ebbd955-0431-40fc-8380-ffafb06f2958 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: c6283570-4ee2-47bc-b58a-fbfe57acbcde] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:22.183575 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5ebbd955-0431-40fc-8380-ffafb06f2958 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:22.184024 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5ebbd955-0431-40fc-8380-ffafb06f2958 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:22.185008 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5ebbd955-0431-40fc-8380-ffafb06f2958 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:22.185441 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5ebbd955-0431-40fc-8380-ffafb06f2958 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:22.227623 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [req-5351a08a-fe28-41b5-a4fa-7a8c295552ce req-6b89ac00-c7fa-4267-870b-6235fabd0db6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86395107-d320-45d8-83de-f1848858be10", "name": "network-vif-plugged", "status": "completed", "tag": "85ceb16f-0c27-48e9-ab76-5cd49eb12802"}]} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:15:22.247277 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:15:22.247277 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: warnings.warn(msg) Dec 14 03:15:22.284750 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [req-5351a08a-fe28-41b5-a4fa-7a8c295552ce req-6b89ac00-c7fa-4267-870b-6235fabd0db6 service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:22.290157 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [req-5351a08a-fe28-41b5-a4fa-7a8c295552ce req-6b89ac00-c7fa-4267-870b-6235fabd0db6 service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:22.333076 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.compute.server_external_events [req-5351a08a-fe28-41b5-a4fa-7a8c295552ce req-6b89ac00-c7fa-4267-870b-6235fabd0db6 service nova] Creating event network-vif-plugged:85ceb16f-0c27-48e9-ab76-5cd49eb12802 for instance 86395107-d320-45d8-83de-f1848858be10 on hv-cinder-81803 Dec 14 03:15:22.341543 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [req-5351a08a-fe28-41b5-a4fa-7a8c295552ce req-6b89ac00-c7fa-4267-870b-6235fabd0db6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134468 Dec 14 03:15:22.342577 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 58/114] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Dec 14 03:15:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 14 03:15:22.407073 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-c709858c-aa06-47ca-842e-ede0a9090164 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:22.407778 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-c709858c-aa06-47ca-842e-ede0a9090164 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] [instance: ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:22.417989 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c709858c-aa06-47ca-842e-ede0a9090164 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:22.420091 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c709858c-aa06-47ca-842e-ede0a9090164 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:22.426598 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c709858c-aa06-47ca-842e-ede0a9090164 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:22.428331 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c709858c-aa06-47ca-842e-ede0a9090164 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:22.570761 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-5ebbd955-0431-40fc-8380-ffafb06f2958 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:22.595738 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-5ebbd955-0431-40fc-8380-ffafb06f2958 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde" status: 200 len: 1522 microversion: 2.1 time: 0.427653 Dec 14 03:15:22.596841 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 57/115] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:15:22 2021] GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde => generated 1522 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:15:22.763075 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-c709858c-aa06-47ca-842e-ede0a9090164 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f5b824c4204f5da272b60d907bb2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722b58145d434e1181ebd90e63eb1255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:22.771701 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-c709858c-aa06-47ca-842e-ede0a9090164 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] 10.222.0.43 "GET /compute/v2.1/servers/ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d" status: 200 len: 1315 microversion: 2.1 time: 0.370368 Dec 14 03:15:22.773156 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 59/116] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:15:22 2021] GET /compute/v2.1/servers/ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d => generated 1315 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:15:22.842713 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-f8655ea7-8547-4cda-adf7-64ef549a0fa0 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:22.843775 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-f8655ea7-8547-4cda-adf7-64ef549a0fa0 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:22.852320 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f8655ea7-8547-4cda-adf7-64ef549a0fa0 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:22.853173 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f8655ea7-8547-4cda-adf7-64ef549a0fa0 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:22.854224 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f8655ea7-8547-4cda-adf7-64ef549a0fa0 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:22.854862 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f8655ea7-8547-4cda-adf7-64ef549a0fa0 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:23.048423 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-7da62914-409a-426f-ac7e-f5f142c5ba5a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:23.049035 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-7da62914-409a-426f-ac7e-f5f142c5ba5a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:23.055296 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-7da62914-409a-426f-ac7e-f5f142c5ba5a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:23.055751 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-7da62914-409a-426f-ac7e-f5f142c5ba5a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:23.056535 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-7da62914-409a-426f-ac7e-f5f142c5ba5a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:23.056973 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-7da62914-409a-426f-ac7e-f5f142c5ba5a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:23.074670 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-f8655ea7-8547-4cda-adf7-64ef549a0fa0 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107444106cda461dab7c403665d92613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:23.089281 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-f8655ea7-8547-4cda-adf7-64ef549a0fa0 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364" status: 200 len: 1362 microversion: 2.1 time: 0.251482 Dec 14 03:15:23.090263 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 58/117] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:15:22 2021] GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364 => generated 1362 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:15:23.313350 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [req-ede592ee-2100-40eb-9a1c-fa2b5e77272b req-56ba24a5-bc3f-4ea4-b624-97acdef47b40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d", "tag": "8512939b-7934-497d-9e64-85606ebc8347"}]} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:15:23.316035 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:15:23.316035 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: warnings.warn(msg) Dec 14 03:15:23.340392 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-ede592ee-2100-40eb-9a1c-fa2b5e77272b req-56ba24a5-bc3f-4ea4-b624-97acdef47b40 service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:23.341165 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-ede592ee-2100-40eb-9a1c-fa2b5e77272b req-56ba24a5-bc3f-4ea4-b624-97acdef47b40 service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:23.346862 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-7da62914-409a-426f-ac7e-f5f142c5ba5a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:23.366817 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.compute.server_external_events [req-ede592ee-2100-40eb-9a1c-fa2b5e77272b req-56ba24a5-bc3f-4ea4-b624-97acdef47b40 service nova] Creating event network-changed:8512939b-7934-497d-9e64-85606ebc8347 for instance ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d on hv-cinder-81803 Dec 14 03:15:23.372388 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-7da62914-409a-426f-ac7e-f5f142c5ba5a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:23.373441 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [req-ede592ee-2100-40eb-9a1c-fa2b5e77272b req-56ba24a5-bc3f-4ea4-b624-97acdef47b40 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064758 Dec 14 03:15:23.377231 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-7da62914-409a-426f-ac7e-f5f142c5ba5a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:23.378572 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 59/118] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Dec 14 03:15:23 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:15:23.382564 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-7da62914-409a-426f-ac7e-f5f142c5ba5a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1407 microversion: 2.20 time: 0.336429 Dec 14 03:15:23.383974 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 60/119] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:15:23 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1407 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 14 03:15:23.614471 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-9f278113-9512-4ea5-acc8-0dce3091e2b6 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:23.615532 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-9f278113-9512-4ea5-acc8-0dce3091e2b6 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: c6283570-4ee2-47bc-b58a-fbfe57acbcde] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:23.623205 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9f278113-9512-4ea5-acc8-0dce3091e2b6 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:23.624197 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9f278113-9512-4ea5-acc8-0dce3091e2b6 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:23.626928 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9f278113-9512-4ea5-acc8-0dce3091e2b6 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:23.627653 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9f278113-9512-4ea5-acc8-0dce3091e2b6 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:23.787736 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-9f278113-9512-4ea5-acc8-0dce3091e2b6 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:23.791521 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-3db1457c-d664-4e94-9f9e-7bb27e58abf7 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:23.792330 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-3db1457c-d664-4e94-9f9e-7bb27e58abf7 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] [instance: ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:23.796578 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-9f278113-9512-4ea5-acc8-0dce3091e2b6 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde" status: 200 len: 1522 microversion: 2.1 time: 0.186527 Dec 14 03:15:23.806504 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-3db1457c-d664-4e94-9f9e-7bb27e58abf7 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:23.806504 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-3db1457c-d664-4e94-9f9e-7bb27e58abf7 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:23.806504 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-3db1457c-d664-4e94-9f9e-7bb27e58abf7 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:23.806504 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-3db1457c-d664-4e94-9f9e-7bb27e58abf7 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:23.807665 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 60/120] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:15:23 2021] GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:15:23.961699 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-3db1457c-d664-4e94-9f9e-7bb27e58abf7 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f5b824c4204f5da272b60d907bb2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722b58145d434e1181ebd90e63eb1255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:23.971457 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-3db1457c-d664-4e94-9f9e-7bb27e58abf7 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] 10.222.0.43 "GET /compute/v2.1/servers/ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d" status: 200 len: 1315 microversion: 2.1 time: 0.184711 Dec 14 03:15:23.973773 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 61/121] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:15:23 2021] GET /compute/v2.1/servers/ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 03:15:24.108106 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-8a02a414-8b36-4965-b612-e397752be656 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:24.108799 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-8a02a414-8b36-4965-b612-e397752be656 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:24.118615 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8a02a414-8b36-4965-b612-e397752be656 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:24.119101 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8a02a414-8b36-4965-b612-e397752be656 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:24.119940 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8a02a414-8b36-4965-b612-e397752be656 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:24.120379 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8a02a414-8b36-4965-b612-e397752be656 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:24.337484 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-8a02a414-8b36-4965-b612-e397752be656 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107444106cda461dab7c403665d92613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:24.350007 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-8a02a414-8b36-4965-b612-e397752be656 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364" status: 200 len: 1362 microversion: 2.1 time: 0.246733 Dec 14 03:15:24.350539 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 61/122] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:15:24 2021] GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364 => generated 1362 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:15:24.402076 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-535e53ae-d369-4d1a-b01e-a1b5fb0859d7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:24.403516 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-535e53ae-d369-4d1a-b01e-a1b5fb0859d7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:24.412083 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-535e53ae-d369-4d1a-b01e-a1b5fb0859d7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:24.412755 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-535e53ae-d369-4d1a-b01e-a1b5fb0859d7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:24.413695 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-535e53ae-d369-4d1a-b01e-a1b5fb0859d7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:24.414278 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-535e53ae-d369-4d1a-b01e-a1b5fb0859d7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:24.715525 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-535e53ae-d369-4d1a-b01e-a1b5fb0859d7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:24.724293 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-535e53ae-d369-4d1a-b01e-a1b5fb0859d7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:24.725814 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-535e53ae-d369-4d1a-b01e-a1b5fb0859d7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:24.726950 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-535e53ae-d369-4d1a-b01e-a1b5fb0859d7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1407 microversion: 2.20 time: 0.329270 Dec 14 03:15:24.727536 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 62/123] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:15:24 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1407 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 14 03:15:24.813454 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-b881d4d9-1cbc-4348-9cf3-f17704e2053a tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:24.814235 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-b881d4d9-1cbc-4348-9cf3-f17704e2053a tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: c6283570-4ee2-47bc-b58a-fbfe57acbcde] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:24.821554 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b881d4d9-1cbc-4348-9cf3-f17704e2053a tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:24.822080 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b881d4d9-1cbc-4348-9cf3-f17704e2053a tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:24.822847 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b881d4d9-1cbc-4348-9cf3-f17704e2053a tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:24.823500 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b881d4d9-1cbc-4348-9cf3-f17704e2053a tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:24.958533 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-b881d4d9-1cbc-4348-9cf3-f17704e2053a tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:24.965813 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-b881d4d9-1cbc-4348-9cf3-f17704e2053a tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde" status: 200 len: 1522 microversion: 2.1 time: 0.156067 Dec 14 03:15:24.966672 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 62/124] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:15:24 2021] GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:15:24.989489 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-9525108d-1450-46ba-82ad-6c0d3b3d3fa7 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:24.990105 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-9525108d-1450-46ba-82ad-6c0d3b3d3fa7 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] [instance: ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:24.995977 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-9525108d-1450-46ba-82ad-6c0d3b3d3fa7 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:24.996430 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-9525108d-1450-46ba-82ad-6c0d3b3d3fa7 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:24.997204 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-9525108d-1450-46ba-82ad-6c0d3b3d3fa7 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:24.997643 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-9525108d-1450-46ba-82ad-6c0d3b3d3fa7 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:25.142028 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-9525108d-1450-46ba-82ad-6c0d3b3d3fa7 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f5b824c4204f5da272b60d907bb2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722b58145d434e1181ebd90e63eb1255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:25.149831 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-9525108d-1450-46ba-82ad-6c0d3b3d3fa7 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] 10.222.0.43 "GET /compute/v2.1/servers/ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d" status: 200 len: 1315 microversion: 2.1 time: 0.164205 Dec 14 03:15:25.150737 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 63/125] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:15:24 2021] GET /compute/v2.1/servers/ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:15:25.369433 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-22b8dfaa-d42f-46e5-88aa-0c0adfe08c0b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:25.370161 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-22b8dfaa-d42f-46e5-88aa-0c0adfe08c0b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:25.378723 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-22b8dfaa-d42f-46e5-88aa-0c0adfe08c0b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:25.379937 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-22b8dfaa-d42f-46e5-88aa-0c0adfe08c0b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:25.381026 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-22b8dfaa-d42f-46e5-88aa-0c0adfe08c0b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:25.381619 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-22b8dfaa-d42f-46e5-88aa-0c0adfe08c0b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:25.510192 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-22b8dfaa-d42f-46e5-88aa-0c0adfe08c0b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107444106cda461dab7c403665d92613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:25.522278 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-22b8dfaa-d42f-46e5-88aa-0c0adfe08c0b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364" status: 200 len: 1362 microversion: 2.1 time: 0.157555 Dec 14 03:15:25.522948 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 63/126] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:15:25 2021] GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:15:25.745355 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-75f395f6-cbe0-49a0-8a07-04ac751df3f7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:25.746602 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-75f395f6-cbe0-49a0-8a07-04ac751df3f7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:25.766730 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-75f395f6-cbe0-49a0-8a07-04ac751df3f7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:25.767648 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-75f395f6-cbe0-49a0-8a07-04ac751df3f7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:25.768756 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-75f395f6-cbe0-49a0-8a07-04ac751df3f7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:25.771841 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-75f395f6-cbe0-49a0-8a07-04ac751df3f7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:25.982256 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-327e26dd-5908-4b4c-b4f6-c9c517dd8dd0 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:25.982869 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-327e26dd-5908-4b4c-b4f6-c9c517dd8dd0 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: c6283570-4ee2-47bc-b58a-fbfe57acbcde] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:25.990889 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-327e26dd-5908-4b4c-b4f6-c9c517dd8dd0 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:25.991580 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-327e26dd-5908-4b4c-b4f6-c9c517dd8dd0 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:25.992374 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-327e26dd-5908-4b4c-b4f6-c9c517dd8dd0 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:25.992804 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-327e26dd-5908-4b4c-b4f6-c9c517dd8dd0 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:26.002782 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-75f395f6-cbe0-49a0-8a07-04ac751df3f7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:26.012699 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-75f395f6-cbe0-49a0-8a07-04ac751df3f7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:26.014420 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-75f395f6-cbe0-49a0-8a07-04ac751df3f7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:26.016005 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-75f395f6-cbe0-49a0-8a07-04ac751df3f7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1599 microversion: 2.20 time: 0.274119 Dec 14 03:15:26.016571 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 64/127] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:15:25 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1599 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:15:26.036028 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-bc20ea0b-bdb3-4bdb-a5f6-733cab8d3c7b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:26.036527 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-bc20ea0b-bdb3-4bdb-a5f6-733cab8d3c7b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:26.042303 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-bc20ea0b-bdb3-4bdb-a5f6-733cab8d3c7b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:26.042781 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-bc20ea0b-bdb3-4bdb-a5f6-733cab8d3c7b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:26.043594 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-bc20ea0b-bdb3-4bdb-a5f6-733cab8d3c7b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:26.044025 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-bc20ea0b-bdb3-4bdb-a5f6-733cab8d3c7b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:26.175103 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-bc20ea0b-bdb3-4bdb-a5f6-733cab8d3c7b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.143198 Dec 14 03:15:26.181817 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 65/128] 10.222.0.43 () {60 vars in 1315 bytes} [Tue Dec 14 03:15:26 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/os-interface => generated 284 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:15:26.183164 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-1004f41d-6f56-4288-95cc-6c17567c45fe tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:26.184111 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-1004f41d-6f56-4288-95cc-6c17567c45fe tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] [instance: ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:26.192400 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-1004f41d-6f56-4288-95cc-6c17567c45fe tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:26.193696 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-1004f41d-6f56-4288-95cc-6c17567c45fe tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:26.194661 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-1004f41d-6f56-4288-95cc-6c17567c45fe tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:26.195288 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-1004f41d-6f56-4288-95cc-6c17567c45fe tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:26.212118 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-327e26dd-5908-4b4c-b4f6-c9c517dd8dd0 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:26.219911 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-327e26dd-5908-4b4c-b4f6-c9c517dd8dd0 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde" status: 200 len: 1522 microversion: 2.1 time: 0.242074 Dec 14 03:15:26.220771 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 64/129] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:15:25 2021] GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde => generated 1522 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 03:15:26.353727 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-1004f41d-6f56-4288-95cc-6c17567c45fe tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f5b824c4204f5da272b60d907bb2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722b58145d434e1181ebd90e63eb1255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:26.361261 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-1004f41d-6f56-4288-95cc-6c17567c45fe tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] 10.222.0.43 "GET /compute/v2.1/servers/ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d" status: 200 len: 1315 microversion: 2.1 time: 0.183876 Dec 14 03:15:26.361828 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 66/130] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:15:26 2021] GET /compute/v2.1/servers/ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d => generated 1315 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:15:26.539322 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-77f9ab37-e2e8-40d7-bf70-4af7351dfb67 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:26.540684 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-77f9ab37-e2e8-40d7-bf70-4af7351dfb67 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:26.547225 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-77f9ab37-e2e8-40d7-bf70-4af7351dfb67 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:26.547881 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-77f9ab37-e2e8-40d7-bf70-4af7351dfb67 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:26.548879 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-77f9ab37-e2e8-40d7-bf70-4af7351dfb67 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:26.549323 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-77f9ab37-e2e8-40d7-bf70-4af7351dfb67 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:26.760417 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-77f9ab37-e2e8-40d7-bf70-4af7351dfb67 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107444106cda461dab7c403665d92613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:26.774214 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-77f9ab37-e2e8-40d7-bf70-4af7351dfb67 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364" status: 200 len: 1362 microversion: 2.1 time: 0.238172 Dec 14 03:15:26.775716 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 65/131] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:15:26 2021] GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364 => generated 1362 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:15:27.237576 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-a13ff05f-7aaa-414e-985e-edc78eccb4be tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:27.241321 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-a13ff05f-7aaa-414e-985e-edc78eccb4be tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: c6283570-4ee2-47bc-b58a-fbfe57acbcde] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:27.250699 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a13ff05f-7aaa-414e-985e-edc78eccb4be tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:27.251879 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a13ff05f-7aaa-414e-985e-edc78eccb4be tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:27.253499 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a13ff05f-7aaa-414e-985e-edc78eccb4be tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:27.254752 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a13ff05f-7aaa-414e-985e-edc78eccb4be tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:27.395671 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-7306f4ec-0483-46f3-b081-4de1668a25ce tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:27.396549 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-7306f4ec-0483-46f3-b081-4de1668a25ce tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] [instance: ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:27.407566 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7306f4ec-0483-46f3-b081-4de1668a25ce tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:27.408017 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7306f4ec-0483-46f3-b081-4de1668a25ce tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:27.408796 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7306f4ec-0483-46f3-b081-4de1668a25ce tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:27.409219 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7306f4ec-0483-46f3-b081-4de1668a25ce tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:27.469037 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-a13ff05f-7aaa-414e-985e-edc78eccb4be tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:27.477786 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-a13ff05f-7aaa-414e-985e-edc78eccb4be tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde" status: 200 len: 1522 microversion: 2.1 time: 0.244167 Dec 14 03:15:27.485032 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 67/132] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:15:27 2021] GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde => generated 1522 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:15:27.623005 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-7306f4ec-0483-46f3-b081-4de1668a25ce tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f5b824c4204f5da272b60d907bb2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722b58145d434e1181ebd90e63eb1255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:27.636202 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-7306f4ec-0483-46f3-b081-4de1668a25ce tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] 10.222.0.43 "GET /compute/v2.1/servers/ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d" status: 200 len: 1315 microversion: 2.1 time: 0.260640 Dec 14 03:15:27.637108 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 66/133] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:15:27 2021] GET /compute/v2.1/servers/ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d => generated 1315 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:15:27.770023 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-bef133cf-b336-4a3b-903d-02f8b277daa7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:15:27.771250 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-bef133cf-b336-4a3b-903d-02f8b277daa7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:27.775845 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [req-cc5c5725-b020-4ebe-977a-13e54c48c5a2 req-296120f8-fada-4b4e-bd72-3ef9821b8999 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86395107-d320-45d8-83de-f1848858be10", "tag": "85ceb16f-0c27-48e9-ab76-5cd49eb12802"}]} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:15:27.777679 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:15:27.777679 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: warnings.warn(msg) Dec 14 03:15:27.778523 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-bef133cf-b336-4a3b-903d-02f8b277daa7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:27.779182 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-bef133cf-b336-4a3b-903d-02f8b277daa7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:27.780252 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-bef133cf-b336-4a3b-903d-02f8b277daa7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:27.780928 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-bef133cf-b336-4a3b-903d-02f8b277daa7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:27.786881 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-cc5c5725-b020-4ebe-977a-13e54c48c5a2 req-296120f8-fada-4b4e-bd72-3ef9821b8999 service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:27.787858 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-cc5c5725-b020-4ebe-977a-13e54c48c5a2 req-296120f8-fada-4b4e-bd72-3ef9821b8999 service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:27.800348 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.compute.server_external_events [req-cc5c5725-b020-4ebe-977a-13e54c48c5a2 req-296120f8-fada-4b4e-bd72-3ef9821b8999 service nova] Creating event network-changed:85ceb16f-0c27-48e9-ab76-5cd49eb12802 for instance 86395107-d320-45d8-83de-f1848858be10 on hv-cinder-81803 Dec 14 03:15:27.805756 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [req-cc5c5725-b020-4ebe-977a-13e54c48c5a2 req-296120f8-fada-4b4e-bd72-3ef9821b8999 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034589 Dec 14 03:15:27.806939 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 67/134] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Dec 14 03:15:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 14 03:15:27.815229 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-db4aebaa-a503-424e-85f4-33e8eb65de14 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:27.816739 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-db4aebaa-a503-424e-85f4-33e8eb65de14 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:27.822809 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-db4aebaa-a503-424e-85f4-33e8eb65de14 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:27.823371 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-db4aebaa-a503-424e-85f4-33e8eb65de14 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:27.824215 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-db4aebaa-a503-424e-85f4-33e8eb65de14 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:27.824762 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-db4aebaa-a503-424e-85f4-33e8eb65de14 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:27.951074 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-bef133cf-b336-4a3b-903d-02f8b277daa7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action" status: 200 len: 14 microversion: 2.20 time: 0.185388 Dec 14 03:15:27.957592 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 68/135] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:15:27 2021] POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action => generated 14 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:15:28.004462 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-db4aebaa-a503-424e-85f4-33e8eb65de14 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107444106cda461dab7c403665d92613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:28.013370 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-db4aebaa-a503-424e-85f4-33e8eb65de14 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364" status: 200 len: 1362 microversion: 2.1 time: 0.201620 Dec 14 03:15:28.024837 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 68/136] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:15:27 2021] GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364 => generated 1362 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:15:28.401031 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [req-5146e2d6-443f-4dcc-a097-d77fac6f579f req-d21cb1b7-bec8-4d84-9064-5eccd5e75d7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd35b83c-0304-43fc-85ec-731c395d3364", "name": "network-vif-plugged", "status": "completed", "tag": "b1d9bd41-b159-47f7-8b8c-3145159e82db"}]} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:15:28.404023 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:15:28.404023 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: warnings.warn(msg) Dec 14 03:15:28.420455 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [req-5146e2d6-443f-4dcc-a097-d77fac6f579f req-d21cb1b7-bec8-4d84-9064-5eccd5e75d7a service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:28.455268 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [req-5146e2d6-443f-4dcc-a097-d77fac6f579f req-d21cb1b7-bec8-4d84-9064-5eccd5e75d7a service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:28.494829 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.compute.server_external_events [req-5146e2d6-443f-4dcc-a097-d77fac6f579f req-d21cb1b7-bec8-4d84-9064-5eccd5e75d7a service nova] Creating event network-vif-plugged:b1d9bd41-b159-47f7-8b8c-3145159e82db for instance fd35b83c-0304-43fc-85ec-731c395d3364 on hv-cinder-81803 Dec 14 03:15:28.501374 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-e02f785b-d08c-44f5-a999-ae3dc92eb34a tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:28.501996 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-e02f785b-d08c-44f5-a999-ae3dc92eb34a tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: c6283570-4ee2-47bc-b58a-fbfe57acbcde] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:28.516586 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e02f785b-d08c-44f5-a999-ae3dc92eb34a tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:28.517044 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e02f785b-d08c-44f5-a999-ae3dc92eb34a tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:28.517209 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [req-5146e2d6-443f-4dcc-a097-d77fac6f579f req-d21cb1b7-bec8-4d84-9064-5eccd5e75d7a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119662 Dec 14 03:15:28.517843 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e02f785b-d08c-44f5-a999-ae3dc92eb34a tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:28.518275 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e02f785b-d08c-44f5-a999-ae3dc92eb34a tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:28.524491 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 69/137] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Dec 14 03:15:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:15:28.671076 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-b4849f7d-91a4-4379-ad0b-432d0e539b80 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:28.679064 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-b4849f7d-91a4-4379-ad0b-432d0e539b80 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] [instance: ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:28.701032 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b4849f7d-91a4-4379-ad0b-432d0e539b80 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:28.703425 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b4849f7d-91a4-4379-ad0b-432d0e539b80 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:28.707604 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b4849f7d-91a4-4379-ad0b-432d0e539b80 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:28.714702 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b4849f7d-91a4-4379-ad0b-432d0e539b80 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:28.728523 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-e02f785b-d08c-44f5-a999-ae3dc92eb34a tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:28.739719 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-e02f785b-d08c-44f5-a999-ae3dc92eb34a tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde" status: 200 len: 1522 microversion: 2.1 time: 0.241923 Dec 14 03:15:28.751320 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 69/138] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:15:28 2021] GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde => generated 1522 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 03:15:28.969705 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-4e042909-507f-459d-9d36-e691cdc3b88c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:15:28.970760 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-4e042909-507f-459d-9d36-e691cdc3b88c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:28.985421 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4e042909-507f-459d-9d36-e691cdc3b88c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:28.985871 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4e042909-507f-459d-9d36-e691cdc3b88c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:28.986655 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4e042909-507f-459d-9d36-e691cdc3b88c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:28.987108 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4e042909-507f-459d-9d36-e691cdc3b88c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:28.998283 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-b4849f7d-91a4-4379-ad0b-432d0e539b80 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f5b824c4204f5da272b60d907bb2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722b58145d434e1181ebd90e63eb1255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:29.006782 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-b4849f7d-91a4-4379-ad0b-432d0e539b80 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] 10.222.0.43 "GET /compute/v2.1/servers/ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d" status: 200 len: 1315 microversion: 2.1 time: 0.353402 Dec 14 03:15:29.008300 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 70/139] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:15:28 2021] GET /compute/v2.1/servers/ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d => generated 1315 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:15:29.032567 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-e4aec438-63e4-44b0-aa52-ca86a5a8b94f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:29.033737 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-e4aec438-63e4-44b0-aa52-ca86a5a8b94f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:29.049257 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-e4aec438-63e4-44b0-aa52-ca86a5a8b94f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:29.049257 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-e4aec438-63e4-44b0-aa52-ca86a5a8b94f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:29.049257 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-e4aec438-63e4-44b0-aa52-ca86a5a8b94f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:29.049257 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-e4aec438-63e4-44b0-aa52-ca86a5a8b94f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:29.211974 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-e4aec438-63e4-44b0-aa52-ca86a5a8b94f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107444106cda461dab7c403665d92613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:29.219813 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-e4aec438-63e4-44b0-aa52-ca86a5a8b94f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364" status: 200 len: 1362 microversion: 2.1 time: 0.192349 Dec 14 03:15:29.220421 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 71/140] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:15:29 2021] GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364 => generated 1362 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 03:15:29.696387 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-4e042909-507f-459d-9d36-e691cdc3b88c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action" status: 200 len: 14 microversion: 2.20 time: 0.731437 Dec 14 03:15:29.699967 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 70/141] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:15:28 2021] POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action => generated 14 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 03:15:29.760119 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-8669403d-f5d9-4628-b496-a69154eec10b tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:29.762199 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-8669403d-f5d9-4628-b496-a69154eec10b tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: c6283570-4ee2-47bc-b58a-fbfe57acbcde] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:29.771256 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-8669403d-f5d9-4628-b496-a69154eec10b tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:29.771701 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-8669403d-f5d9-4628-b496-a69154eec10b tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:29.772667 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-8669403d-f5d9-4628-b496-a69154eec10b tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:29.773256 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-8669403d-f5d9-4628-b496-a69154eec10b tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:29.929216 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-8669403d-f5d9-4628-b496-a69154eec10b tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:29.936519 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-8669403d-f5d9-4628-b496-a69154eec10b tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde" status: 200 len: 1522 microversion: 2.1 time: 0.183379 Dec 14 03:15:29.937079 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 72/142] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:15:29 2021] GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:15:30.024910 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-5f119539-77a9-4286-8e3a-810aad5414de tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:30.026299 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-5f119539-77a9-4286-8e3a-810aad5414de tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] [instance: ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:30.033106 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5f119539-77a9-4286-8e3a-810aad5414de tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:30.033552 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5f119539-77a9-4286-8e3a-810aad5414de tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:30.034339 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5f119539-77a9-4286-8e3a-810aad5414de tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:30.034772 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5f119539-77a9-4286-8e3a-810aad5414de tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:30.186237 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-5f119539-77a9-4286-8e3a-810aad5414de tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f5b824c4204f5da272b60d907bb2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722b58145d434e1181ebd90e63eb1255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:30.197710 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-5f119539-77a9-4286-8e3a-810aad5414de tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] 10.222.0.43 "GET /compute/v2.1/servers/ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d" status: 200 len: 1315 microversion: 2.1 time: 0.176674 Dec 14 03:15:30.198918 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 71/143] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:15:30 2021] GET /compute/v2.1/servers/ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:15:30.236361 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-827101c6-99ee-435e-a685-d9d9d0c77946 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:30.236990 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-827101c6-99ee-435e-a685-d9d9d0c77946 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:30.242982 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-827101c6-99ee-435e-a685-d9d9d0c77946 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:30.243525 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-827101c6-99ee-435e-a685-d9d9d0c77946 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:30.244343 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-827101c6-99ee-435e-a685-d9d9d0c77946 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:30.244773 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-827101c6-99ee-435e-a685-d9d9d0c77946 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:30.403569 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-827101c6-99ee-435e-a685-d9d9d0c77946 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107444106cda461dab7c403665d92613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:30.411437 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-827101c6-99ee-435e-a685-d9d9d0c77946 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364" status: 200 len: 1362 microversion: 2.1 time: 0.179067 Dec 14 03:15:30.412078 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 73/144] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:15:30 2021] GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364 => generated 1362 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:15:30.707351 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-197c9cc9-7abd-441d-9002-7672a0c1face tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:15:30.708311 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-197c9cc9-7abd-441d-9002-7672a0c1face tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:30.714971 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-197c9cc9-7abd-441d-9002-7672a0c1face tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:30.715440 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-197c9cc9-7abd-441d-9002-7672a0c1face tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:30.716210 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-197c9cc9-7abd-441d-9002-7672a0c1face tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:30.716631 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-197c9cc9-7abd-441d-9002-7672a0c1face tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:30.953315 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-b2c7b698-dadd-4fe6-9826-3337844b0caa tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:30.959917 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-b2c7b698-dadd-4fe6-9826-3337844b0caa tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: c6283570-4ee2-47bc-b58a-fbfe57acbcde] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:30.973397 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b2c7b698-dadd-4fe6-9826-3337844b0caa tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:30.974459 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b2c7b698-dadd-4fe6-9826-3337844b0caa tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:30.975473 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b2c7b698-dadd-4fe6-9826-3337844b0caa tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:30.976077 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b2c7b698-dadd-4fe6-9826-3337844b0caa tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:31.014965 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-197c9cc9-7abd-441d-9002-7672a0c1face tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action" status: 200 len: 14 microversion: 2.20 time: 0.310796 Dec 14 03:15:31.015925 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 72/145] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:15:30 2021] POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action => generated 14 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:15:31.145757 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-b2c7b698-dadd-4fe6-9826-3337844b0caa tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:31.153215 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-b2c7b698-dadd-4fe6-9826-3337844b0caa tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde" status: 200 len: 1522 microversion: 2.1 time: 0.203669 Dec 14 03:15:31.153924 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 74/146] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:15:30 2021] GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:15:31.215765 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-48f7ee5d-4b41-48ac-8e62-5e246bd150de tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:31.216472 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-48f7ee5d-4b41-48ac-8e62-5e246bd150de tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] [instance: ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:31.232139 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-48f7ee5d-4b41-48ac-8e62-5e246bd150de tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:31.232597 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-48f7ee5d-4b41-48ac-8e62-5e246bd150de tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:31.235167 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-48f7ee5d-4b41-48ac-8e62-5e246bd150de tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:31.235615 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-48f7ee5d-4b41-48ac-8e62-5e246bd150de tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:31.428229 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-777d8355-a13c-43c7-aa5d-fc440c0e061f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:31.428985 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-777d8355-a13c-43c7-aa5d-fc440c0e061f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:31.432718 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-48f7ee5d-4b41-48ac-8e62-5e246bd150de tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f5b824c4204f5da272b60d907bb2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722b58145d434e1181ebd90e63eb1255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:31.436053 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-777d8355-a13c-43c7-aa5d-fc440c0e061f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:31.437940 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-777d8355-a13c-43c7-aa5d-fc440c0e061f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:31.440366 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-777d8355-a13c-43c7-aa5d-fc440c0e061f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:31.441000 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-48f7ee5d-4b41-48ac-8e62-5e246bd150de tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] 10.222.0.43 "GET /compute/v2.1/servers/ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d" status: 200 len: 1315 microversion: 2.1 time: 0.229352 Dec 14 03:15:31.441569 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 73/147] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:15:31 2021] GET /compute/v2.1/servers/ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:15:31.441700 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-777d8355-a13c-43c7-aa5d-fc440c0e061f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:31.611586 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-777d8355-a13c-43c7-aa5d-fc440c0e061f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107444106cda461dab7c403665d92613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:31.619764 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-777d8355-a13c-43c7-aa5d-fc440c0e061f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364" status: 200 len: 1362 microversion: 2.1 time: 0.195516 Dec 14 03:15:31.620341 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 75/148] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:15:31 2021] GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364 => generated 1362 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:15:32.029551 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-6608c29d-3d91-41e7-93ac-72fb8e07a642 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:15:32.030943 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-6608c29d-3d91-41e7-93ac-72fb8e07a642 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:32.044715 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-ca26bd10-2d50-4899-b5ad-fd41b96aa8ea tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:32.045166 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-ca26bd10-2d50-4899-b5ad-fd41b96aa8ea tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] [instance: d9988bfe-afac-40fa-ad73-2db57dadf545] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:32.049707 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6608c29d-3d91-41e7-93ac-72fb8e07a642 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:32.052281 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6608c29d-3d91-41e7-93ac-72fb8e07a642 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:32.053851 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ca26bd10-2d50-4899-b5ad-fd41b96aa8ea tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:32.054760 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6608c29d-3d91-41e7-93ac-72fb8e07a642 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:32.055500 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6608c29d-3d91-41e7-93ac-72fb8e07a642 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:32.056491 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ca26bd10-2d50-4899-b5ad-fd41b96aa8ea tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:32.057288 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ca26bd10-2d50-4899-b5ad-fd41b96aa8ea tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:32.057721 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ca26bd10-2d50-4899-b5ad-fd41b96aa8ea tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:32.097395 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-ca26bd10-2d50-4899-b5ad-fd41b96aa8ea tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] [instance: d9988bfe-afac-40fa-ad73-2db57dadf545] Going to try to terminate instance {{(pid=116071) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 14 03:15:32.172550 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-6608c29d-3d91-41e7-93ac-72fb8e07a642 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action" status: 200 len: 14 microversion: 2.20 time: 0.149055 Dec 14 03:15:32.173622 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 74/149] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:15:32 2021] POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action => generated 14 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:15:32.179957 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [req-b8f3adae-4626-4030-a87e-a70af65d93a8 req-0b1793fb-285a-4eb9-94e3-2f492af2a481 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d", "name": "network-vif-plugged", "status": "completed", "tag": "8512939b-7934-497d-9e64-85606ebc8347"}]} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:15:32.181605 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:15:32.181605 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: warnings.warn(msg) Dec 14 03:15:32.191330 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-b8f3adae-4626-4030-a87e-a70af65d93a8 req-0b1793fb-285a-4eb9-94e3-2f492af2a481 service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:32.192184 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-b8f3adae-4626-4030-a87e-a70af65d93a8 req-0b1793fb-285a-4eb9-94e3-2f492af2a481 service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:32.203643 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-ca26bd10-2d50-4899-b5ad-fd41b96aa8ea tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.43 "DELETE /compute/v2.1/servers/d9988bfe-afac-40fa-ad73-2db57dadf545" status: 204 len: 0 microversion: 2.1 time: 0.162372 Dec 14 03:15:32.204218 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 76/150] 10.222.0.43 () {58 vars in 1238 bytes} [Tue Dec 14 03:15:32 2021] DELETE /compute/v2.1/servers/d9988bfe-afac-40fa-ad73-2db57dadf545 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 14 03:15:32.205728 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.compute.server_external_events [req-b8f3adae-4626-4030-a87e-a70af65d93a8 req-0b1793fb-285a-4eb9-94e3-2f492af2a481 service nova] Creating event network-vif-plugged:8512939b-7934-497d-9e64-85606ebc8347 for instance ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d on hv-cinder-81803 Dec 14 03:15:32.211752 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-d68620a0-a29b-4205-9573-7e6ee1f7192e tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:32.212461 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-d68620a0-a29b-4205-9573-7e6ee1f7192e tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: c6283570-4ee2-47bc-b58a-fbfe57acbcde] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:32.212745 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [req-b8f3adae-4626-4030-a87e-a70af65d93a8 req-0b1793fb-285a-4eb9-94e3-2f492af2a481 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036872 Dec 14 03:15:32.214112 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 75/151] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Dec 14 03:15:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:15:32.220075 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-c928868e-4589-4940-9580-e05d66a40eae tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:32.220902 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-c928868e-4589-4940-9580-e05d66a40eae tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] [instance: d9988bfe-afac-40fa-ad73-2db57dadf545] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:32.227190 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-d68620a0-a29b-4205-9573-7e6ee1f7192e tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:32.228341 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c928868e-4589-4940-9580-e05d66a40eae tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:32.228859 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c928868e-4589-4940-9580-e05d66a40eae tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:32.229446 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-d68620a0-a29b-4205-9573-7e6ee1f7192e tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:32.230170 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c928868e-4589-4940-9580-e05d66a40eae tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:32.230285 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-d68620a0-a29b-4205-9573-7e6ee1f7192e tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:32.230684 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c928868e-4589-4940-9580-e05d66a40eae tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:32.230816 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-d68620a0-a29b-4205-9573-7e6ee1f7192e tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:32.448279 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-d68620a0-a29b-4205-9573-7e6ee1f7192e tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:32.456616 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-c928868e-4589-4940-9580-e05d66a40eae tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a8e0684f10464394e4f935d687cc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efcbf12d6654bc68690363892415b77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:32.458986 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-d68620a0-a29b-4205-9573-7e6ee1f7192e tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde" status: 200 len: 1522 microversion: 2.1 time: 0.253550 Dec 14 03:15:32.459938 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 77/152] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:15:32 2021] GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde => generated 1522 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:15:32.465617 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-a25c2793-1c9d-4b2a-94fd-5c12bc6a608f tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:32.466290 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-a25c2793-1c9d-4b2a-94fd-5c12bc6a608f tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] [instance: ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:32.466763 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-c928868e-4589-4940-9580-e05d66a40eae tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.43 "GET /compute/v2.1/servers/d9988bfe-afac-40fa-ad73-2db57dadf545" status: 200 len: 1553 microversion: 2.1 time: 0.250969 Dec 14 03:15:32.467594 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 76/153] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:15:32 2021] GET /compute/v2.1/servers/d9988bfe-afac-40fa-ad73-2db57dadf545 => generated 1553 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:15:32.473697 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a25c2793-1c9d-4b2a-94fd-5c12bc6a608f tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:32.474152 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a25c2793-1c9d-4b2a-94fd-5c12bc6a608f tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:32.474938 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a25c2793-1c9d-4b2a-94fd-5c12bc6a608f tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:32.475429 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a25c2793-1c9d-4b2a-94fd-5c12bc6a608f tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:32.637681 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-233e7fde-2f6d-47fa-8e7c-09fa85b1e039 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:32.638487 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-233e7fde-2f6d-47fa-8e7c-09fa85b1e039 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:32.645204 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-233e7fde-2f6d-47fa-8e7c-09fa85b1e039 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:32.645738 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-233e7fde-2f6d-47fa-8e7c-09fa85b1e039 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:32.646641 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-233e7fde-2f6d-47fa-8e7c-09fa85b1e039 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:32.647102 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-233e7fde-2f6d-47fa-8e7c-09fa85b1e039 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:32.705358 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-a25c2793-1c9d-4b2a-94fd-5c12bc6a608f tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f5b824c4204f5da272b60d907bb2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722b58145d434e1181ebd90e63eb1255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:32.714519 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-a25c2793-1c9d-4b2a-94fd-5c12bc6a608f tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] 10.222.0.43 "GET /compute/v2.1/servers/ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d" status: 200 len: 1315 microversion: 2.1 time: 0.253259 Dec 14 03:15:32.715150 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 78/154] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:15:32 2021] GET /compute/v2.1/servers/ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d => generated 1315 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:15:32.844522 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-233e7fde-2f6d-47fa-8e7c-09fa85b1e039 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107444106cda461dab7c403665d92613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:32.852788 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-233e7fde-2f6d-47fa-8e7c-09fa85b1e039 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364" status: 200 len: 1547 microversion: 2.1 time: 0.219394 Dec 14 03:15:32.853580 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 77/155] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:15:32 2021] GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364 => generated 1547 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:15:32.870809 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-c16c7d8b-9edd-4c85-99c7-2531c0c610f5 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:32.871617 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-c16c7d8b-9edd-4c85-99c7-2531c0c610f5 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:32.878203 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c16c7d8b-9edd-4c85-99c7-2531c0c610f5 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:32.878920 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c16c7d8b-9edd-4c85-99c7-2531c0c610f5 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:32.879884 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c16c7d8b-9edd-4c85-99c7-2531c0c610f5 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:32.881107 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c16c7d8b-9edd-4c85-99c7-2531c0c610f5 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:32.980768 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-c16c7d8b-9edd-4c85-99c7-2531c0c610f5 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.114062 Dec 14 03:15:32.981355 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 79/156] 10.222.0.43 () {58 vars in 1274 bytes} [Tue Dec 14 03:15:32 2021] GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/os-interface => generated 284 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:15:33.184790 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-013f2d19-d77f-40b3-adec-11f671501395 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:15:33.186734 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-013f2d19-d77f-40b3-adec-11f671501395 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:33.198108 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-013f2d19-d77f-40b3-adec-11f671501395 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:33.198641 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-013f2d19-d77f-40b3-adec-11f671501395 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:33.199525 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-013f2d19-d77f-40b3-adec-11f671501395 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:33.200025 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-013f2d19-d77f-40b3-adec-11f671501395 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:33.335763 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-013f2d19-d77f-40b3-adec-11f671501395 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action" status: 200 len: 14 microversion: 2.20 time: 0.154996 Dec 14 03:15:33.337291 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 78/157] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:15:33 2021] POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action => generated 14 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 03:15:33.478132 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-37444ad2-8ccb-4482-a1f5-deff38e2a4d4 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:33.479517 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-37444ad2-8ccb-4482-a1f5-deff38e2a4d4 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: c6283570-4ee2-47bc-b58a-fbfe57acbcde] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:33.485441 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-91f5a43c-1021-4dc3-8688-6e7c80e281b6 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:33.486256 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-91f5a43c-1021-4dc3-8688-6e7c80e281b6 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] [instance: d9988bfe-afac-40fa-ad73-2db57dadf545] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:33.499571 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-37444ad2-8ccb-4482-a1f5-deff38e2a4d4 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:33.502127 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-91f5a43c-1021-4dc3-8688-6e7c80e281b6 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:33.502792 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-37444ad2-8ccb-4482-a1f5-deff38e2a4d4 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:33.504349 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-37444ad2-8ccb-4482-a1f5-deff38e2a4d4 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:33.504916 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-91f5a43c-1021-4dc3-8688-6e7c80e281b6 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:33.505420 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-37444ad2-8ccb-4482-a1f5-deff38e2a4d4 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:33.506259 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-91f5a43c-1021-4dc3-8688-6e7c80e281b6 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:33.509470 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-91f5a43c-1021-4dc3-8688-6e7c80e281b6 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:33.953731 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-91f5a43c-1021-4dc3-8688-6e7c80e281b6 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a8e0684f10464394e4f935d687cc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efcbf12d6654bc68690363892415b77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:33.964437 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-91f5a43c-1021-4dc3-8688-6e7c80e281b6 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.43 "GET /compute/v2.1/servers/d9988bfe-afac-40fa-ad73-2db57dadf545" status: 200 len: 1553 microversion: 2.1 time: 0.482474 Dec 14 03:15:33.975800 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 79/158] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:15:33 2021] GET /compute/v2.1/servers/d9988bfe-afac-40fa-ad73-2db57dadf545 => generated 1553 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:15:33.993372 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-a1e6460f-4a93-4b56-a661-94b33e919a6b tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:33.994048 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-a1e6460f-4a93-4b56-a661-94b33e919a6b tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] [instance: ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:34.000742 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-37444ad2-8ccb-4482-a1f5-deff38e2a4d4 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:34.007467 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a1e6460f-4a93-4b56-a661-94b33e919a6b tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:34.007967 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a1e6460f-4a93-4b56-a661-94b33e919a6b tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:34.008700 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a1e6460f-4a93-4b56-a661-94b33e919a6b tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:34.009135 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a1e6460f-4a93-4b56-a661-94b33e919a6b tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:34.013079 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-37444ad2-8ccb-4482-a1f5-deff38e2a4d4 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde" status: 200 len: 1522 microversion: 2.1 time: 0.539156 Dec 14 03:15:34.015442 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 80/159] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:15:33 2021] GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde => generated 1522 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:15:34.266475 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-a1e6460f-4a93-4b56-a661-94b33e919a6b tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f5b824c4204f5da272b60d907bb2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722b58145d434e1181ebd90e63eb1255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:34.273915 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-a1e6460f-4a93-4b56-a661-94b33e919a6b tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] 10.222.0.43 "GET /compute/v2.1/servers/ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d" status: 200 len: 1315 microversion: 2.1 time: 0.297086 Dec 14 03:15:34.274846 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 80/160] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:15:33 2021] GET /compute/v2.1/servers/ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d => generated 1315 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:15:34.347484 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-a79214e0-4f14-457b-8275-1c12c4fd91ec tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:15:34.348564 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-a79214e0-4f14-457b-8275-1c12c4fd91ec tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:34.357539 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a79214e0-4f14-457b-8275-1c12c4fd91ec tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:34.358036 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a79214e0-4f14-457b-8275-1c12c4fd91ec tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:34.358840 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a79214e0-4f14-457b-8275-1c12c4fd91ec tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:34.360327 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a79214e0-4f14-457b-8275-1c12c4fd91ec tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:34.539982 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-a79214e0-4f14-457b-8275-1c12c4fd91ec tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action" status: 200 len: 14 microversion: 2.20 time: 0.195495 Dec 14 03:15:34.545641 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 81/161] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:15:34 2021] POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action => generated 14 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:15:34.697831 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-b23aa22e-6d7a-4ca5-a852-16e9ad7242a7 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:15:34.698651 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-b23aa22e-6d7a-4ca5-a852-16e9ad7242a7 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:34.698864 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [req-b1ca2212-fb0f-4304-bfcc-272ad5566f21 req-a0b12b55-f0a8-4f23-8a78-908e12d970c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd35b83c-0304-43fc-85ec-731c395d3364", "tag": "b1d9bd41-b159-47f7-8b8c-3145159e82db"}]} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:15:34.701196 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:15:34.701196 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: warnings.warn(msg) Dec 14 03:15:34.706004 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b23aa22e-6d7a-4ca5-a852-16e9ad7242a7 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:34.706399 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b23aa22e-6d7a-4ca5-a852-16e9ad7242a7 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:34.710068 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b23aa22e-6d7a-4ca5-a852-16e9ad7242a7 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:34.710068 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b23aa22e-6d7a-4ca5-a852-16e9ad7242a7 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:34.723489 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [req-b1ca2212-fb0f-4304-bfcc-272ad5566f21 req-a0b12b55-f0a8-4f23-8a78-908e12d970c6 service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:34.723937 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [req-b1ca2212-fb0f-4304-bfcc-272ad5566f21 req-a0b12b55-f0a8-4f23-8a78-908e12d970c6 service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:34.745125 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.compute.server_external_events [req-b1ca2212-fb0f-4304-bfcc-272ad5566f21 req-a0b12b55-f0a8-4f23-8a78-908e12d970c6 service nova] Creating event network-changed:b1d9bd41-b159-47f7-8b8c-3145159e82db for instance fd35b83c-0304-43fc-85ec-731c395d3364 on hv-cinder-81803 Dec 14 03:15:34.765683 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [req-b1ca2212-fb0f-4304-bfcc-272ad5566f21 req-a0b12b55-f0a8-4f23-8a78-908e12d970c6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071844 Dec 14 03:15:34.766288 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 82/162] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Dec 14 03:15:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:15:34.985358 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-98fcce91-8d78-4e1d-9b8a-8a7cc07fbb26 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:34.986077 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-98fcce91-8d78-4e1d-9b8a-8a7cc07fbb26 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] [instance: d9988bfe-afac-40fa-ad73-2db57dadf545] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:34.998654 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-98fcce91-8d78-4e1d-9b8a-8a7cc07fbb26 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:34.999531 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-98fcce91-8d78-4e1d-9b8a-8a7cc07fbb26 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:35.001010 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-98fcce91-8d78-4e1d-9b8a-8a7cc07fbb26 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:35.001453 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-98fcce91-8d78-4e1d-9b8a-8a7cc07fbb26 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:35.059765 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-b23aa22e-6d7a-4ca5-a852-16e9ad7242a7 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action" status: 200 len: 14 microversion: 2.1 time: 0.365147 Dec 14 03:15:35.061790 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 81/163] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:15:34 2021] POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action => generated 14 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 14 03:15:35.074801 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-8b11655f-9862-409b-83d0-4e4f561dd6f8 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:35.076393 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-8b11655f-9862-409b-83d0-4e4f561dd6f8 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: c6283570-4ee2-47bc-b58a-fbfe57acbcde] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:35.096821 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8b11655f-9862-409b-83d0-4e4f561dd6f8 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:35.097828 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8b11655f-9862-409b-83d0-4e4f561dd6f8 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:35.098736 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8b11655f-9862-409b-83d0-4e4f561dd6f8 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:35.099291 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8b11655f-9862-409b-83d0-4e4f561dd6f8 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:35.287608 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-98fcce91-8d78-4e1d-9b8a-8a7cc07fbb26 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a8e0684f10464394e4f935d687cc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efcbf12d6654bc68690363892415b77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:35.301482 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-98fcce91-8d78-4e1d-9b8a-8a7cc07fbb26 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.43 "GET /compute/v2.1/servers/d9988bfe-afac-40fa-ad73-2db57dadf545" status: 200 len: 1553 microversion: 2.1 time: 0.320595 Dec 14 03:15:35.305554 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 83/164] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:15:34 2021] GET /compute/v2.1/servers/d9988bfe-afac-40fa-ad73-2db57dadf545 => generated 1553 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:15:35.316342 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-adf82bec-5cf6-4eff-a2a9-555812335afa tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:35.317310 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-adf82bec-5cf6-4eff-a2a9-555812335afa tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] [instance: ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:35.346999 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-adf82bec-5cf6-4eff-a2a9-555812335afa tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:35.350598 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-adf82bec-5cf6-4eff-a2a9-555812335afa tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:35.354806 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-adf82bec-5cf6-4eff-a2a9-555812335afa tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:35.355518 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-adf82bec-5cf6-4eff-a2a9-555812335afa tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:35.368837 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-8b11655f-9862-409b-83d0-4e4f561dd6f8 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:35.379565 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-8b11655f-9862-409b-83d0-4e4f561dd6f8 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde" status: 200 len: 1522 microversion: 2.1 time: 0.314735 Dec 14 03:15:35.390777 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 82/165] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:15:35 2021] GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde => generated 1522 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:15:35.552762 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-119ba156-532c-4b37-a711-c56904d1570d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:15:35.556916 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-119ba156-532c-4b37-a711-c56904d1570d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:35.569808 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-119ba156-532c-4b37-a711-c56904d1570d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:35.576612 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-119ba156-532c-4b37-a711-c56904d1570d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:35.577885 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-119ba156-532c-4b37-a711-c56904d1570d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:35.579776 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-119ba156-532c-4b37-a711-c56904d1570d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:35.801624 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-adf82bec-5cf6-4eff-a2a9-555812335afa tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f5b824c4204f5da272b60d907bb2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722b58145d434e1181ebd90e63eb1255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:35.814018 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-adf82bec-5cf6-4eff-a2a9-555812335afa tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] 10.222.0.43 "GET /compute/v2.1/servers/ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d" status: 200 len: 1464 microversion: 2.1 time: 0.505852 Dec 14 03:15:35.815956 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 84/166] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:15:35 2021] GET /compute/v2.1/servers/ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d => generated 1464 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:15:35.860250 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-220ec047-edf8-4e60-80d0-1f1c49365bfd tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:35.860802 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-220ec047-edf8-4e60-80d0-1f1c49365bfd tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] [instance: ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:35.876884 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-220ec047-edf8-4e60-80d0-1f1c49365bfd tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:35.877917 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-220ec047-edf8-4e60-80d0-1f1c49365bfd tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:35.879625 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-220ec047-edf8-4e60-80d0-1f1c49365bfd tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:35.880569 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-220ec047-edf8-4e60-80d0-1f1c49365bfd tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:35.920519 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-220ec047-edf8-4e60-80d0-1f1c49365bfd tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] [instance: ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d] Going to try to terminate instance {{(pid=116071) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 14 03:15:35.961538 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-119ba156-532c-4b37-a711-c56904d1570d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action" status: 200 len: 14 microversion: 2.20 time: 0.412966 Dec 14 03:15:35.962171 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 83/167] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:15:35 2021] POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action => generated 14 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 03:15:36.078745 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-220ec047-edf8-4e60-80d0-1f1c49365bfd tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] 10.222.0.43 "DELETE /compute/v2.1/servers/ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d" status: 204 len: 0 microversion: 2.1 time: 0.225606 Dec 14 03:15:36.084441 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 85/168] 10.222.0.43 () {58 vars in 1238 bytes} [Tue Dec 14 03:15:35 2021] DELETE /compute/v2.1/servers/ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 14 03:15:36.085681 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-d86f3360-e617-4d06-8372-b60b63f56cc6 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:15:36.086830 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-d86f3360-e617-4d06-8372-b60b63f56cc6 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:36.090447 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-83129e36-5d63-4dcc-95d1-726e176861f9 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:36.091388 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-83129e36-5d63-4dcc-95d1-726e176861f9 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] [instance: ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:36.093877 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d86f3360-e617-4d06-8372-b60b63f56cc6 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:36.094542 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d86f3360-e617-4d06-8372-b60b63f56cc6 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:36.095479 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d86f3360-e617-4d06-8372-b60b63f56cc6 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:36.095923 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d86f3360-e617-4d06-8372-b60b63f56cc6 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:36.098851 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-83129e36-5d63-4dcc-95d1-726e176861f9 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:36.099498 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-83129e36-5d63-4dcc-95d1-726e176861f9 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:36.101229 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-83129e36-5d63-4dcc-95d1-726e176861f9 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:36.101922 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-83129e36-5d63-4dcc-95d1-726e176861f9 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:36.242237 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-d86f3360-e617-4d06-8372-b60b63f56cc6 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action" status: 200 len: 14 microversion: 2.1 time: 0.170945 Dec 14 03:15:36.251963 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 84/169] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:15:36 2021] POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action => generated 14 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 14 03:15:36.284577 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-83129e36-5d63-4dcc-95d1-726e176861f9 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f5b824c4204f5da272b60d907bb2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722b58145d434e1181ebd90e63eb1255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:36.297287 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-83129e36-5d63-4dcc-95d1-726e176861f9 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] 10.222.0.43 "GET /compute/v2.1/servers/ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d" status: 200 len: 1470 microversion: 2.1 time: 0.211157 Dec 14 03:15:36.299002 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 86/170] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:15:36 2021] GET /compute/v2.1/servers/ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d => generated 1470 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:15:36.323318 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-f20cef1d-0b17-4c57-bb70-f93bb6bb1a8f tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:36.324124 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-f20cef1d-0b17-4c57-bb70-f93bb6bb1a8f tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] [instance: d9988bfe-afac-40fa-ad73-2db57dadf545] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:36.333184 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f20cef1d-0b17-4c57-bb70-f93bb6bb1a8f tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:36.334804 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f20cef1d-0b17-4c57-bb70-f93bb6bb1a8f tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:36.337098 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f20cef1d-0b17-4c57-bb70-f93bb6bb1a8f tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:36.337814 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f20cef1d-0b17-4c57-bb70-f93bb6bb1a8f tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:36.398447 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-611e0e50-e542-403a-a398-52fbef04c719 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:36.399308 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-611e0e50-e542-403a-a398-52fbef04c719 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: c6283570-4ee2-47bc-b58a-fbfe57acbcde] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:36.446281 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-611e0e50-e542-403a-a398-52fbef04c719 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:36.446281 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-611e0e50-e542-403a-a398-52fbef04c719 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:36.446281 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-611e0e50-e542-403a-a398-52fbef04c719 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:36.447548 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-611e0e50-e542-403a-a398-52fbef04c719 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:36.677193 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-f20cef1d-0b17-4c57-bb70-f93bb6bb1a8f tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a8e0684f10464394e4f935d687cc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efcbf12d6654bc68690363892415b77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:36.687495 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-f20cef1d-0b17-4c57-bb70-f93bb6bb1a8f tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.43 "GET /compute/v2.1/servers/d9988bfe-afac-40fa-ad73-2db57dadf545" status: 200 len: 1553 microversion: 2.1 time: 0.368558 Dec 14 03:15:36.688075 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 85/171] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:15:36 2021] GET /compute/v2.1/servers/d9988bfe-afac-40fa-ad73-2db57dadf545 => generated 1553 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:15:36.790385 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-611e0e50-e542-403a-a398-52fbef04c719 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:36.804420 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-611e0e50-e542-403a-a398-52fbef04c719 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde" status: 200 len: 1522 microversion: 2.1 time: 0.409154 Dec 14 03:15:36.805717 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 87/172] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:15:36 2021] GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde => generated 1522 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:15:36.972631 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-a7029253-f34f-401a-b28d-ae33fbc74ad4 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:15:36.973864 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-a7029253-f34f-401a-b28d-ae33fbc74ad4 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:36.981191 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a7029253-f34f-401a-b28d-ae33fbc74ad4 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:36.981589 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a7029253-f34f-401a-b28d-ae33fbc74ad4 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:36.982393 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a7029253-f34f-401a-b28d-ae33fbc74ad4 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:36.982956 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a7029253-f34f-401a-b28d-ae33fbc74ad4 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:37.109282 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-a7029253-f34f-401a-b28d-ae33fbc74ad4 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action" status: 200 len: 14 microversion: 2.20 time: 0.140651 Dec 14 03:15:37.110324 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 86/173] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:15:36 2021] POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action => generated 14 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:15:37.259416 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-b8e6e25a-75fe-4b54-a596-7410f296740d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:15:37.260398 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-b8e6e25a-75fe-4b54-a596-7410f296740d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:37.270756 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b8e6e25a-75fe-4b54-a596-7410f296740d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:37.271254 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b8e6e25a-75fe-4b54-a596-7410f296740d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:37.273344 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b8e6e25a-75fe-4b54-a596-7410f296740d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:37.273997 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b8e6e25a-75fe-4b54-a596-7410f296740d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:37.318014 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-4bf60c5e-2cd8-4c73-8c55-5aa169ac3351 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:37.320026 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-4bf60c5e-2cd8-4c73-8c55-5aa169ac3351 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] [instance: ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:37.330977 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4bf60c5e-2cd8-4c73-8c55-5aa169ac3351 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:37.331511 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4bf60c5e-2cd8-4c73-8c55-5aa169ac3351 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:37.332587 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4bf60c5e-2cd8-4c73-8c55-5aa169ac3351 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:37.333078 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4bf60c5e-2cd8-4c73-8c55-5aa169ac3351 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:37.447086 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-b8e6e25a-75fe-4b54-a596-7410f296740d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action" status: 200 len: 14 microversion: 2.1 time: 0.191147 Dec 14 03:15:37.450075 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 88/174] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:15:37 2021] POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action => generated 14 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 14 03:15:37.529354 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [req-dc7e55a5-d713-465f-b8df-d584341c67ae req-914ad56c-3283-4cf4-9f9a-e015f66c0ff5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9988bfe-afac-40fa-ad73-2db57dadf545", "name": "network-vif-deleted", "tag": "9f8a517f-1b7e-4db6-ab49-7f2896db6aed"}]} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:15:37.530932 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:15:37.530932 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: warnings.warn(msg) Dec 14 03:15:37.545049 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [req-dc7e55a5-d713-465f-b8df-d584341c67ae req-914ad56c-3283-4cf4-9f9a-e015f66c0ff5 service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:37.545497 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [req-dc7e55a5-d713-465f-b8df-d584341c67ae req-914ad56c-3283-4cf4-9f9a-e015f66c0ff5 service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:37.557400 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.compute.server_external_events [req-dc7e55a5-d713-465f-b8df-d584341c67ae req-914ad56c-3283-4cf4-9f9a-e015f66c0ff5 service nova] Creating event network-vif-deleted:9f8a517f-1b7e-4db6-ab49-7f2896db6aed for instance d9988bfe-afac-40fa-ad73-2db57dadf545 on hv-cinder-81803 Dec 14 03:15:37.562433 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [req-dc7e55a5-d713-465f-b8df-d584341c67ae req-914ad56c-3283-4cf4-9f9a-e015f66c0ff5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037220 Dec 14 03:15:37.566180 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 89/175] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Dec 14 03:15:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:15:37.568209 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-4bf60c5e-2cd8-4c73-8c55-5aa169ac3351 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f5b824c4204f5da272b60d907bb2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722b58145d434e1181ebd90e63eb1255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:37.578339 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-4bf60c5e-2cd8-4c73-8c55-5aa169ac3351 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] 10.222.0.43 "GET /compute/v2.1/servers/ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d" status: 200 len: 1470 microversion: 2.1 time: 0.266378 Dec 14 03:15:37.578917 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 87/176] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:15:37 2021] GET /compute/v2.1/servers/ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d => generated 1470 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 03:15:37.705977 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-a374b832-006f-4898-a3fe-e647d9ad0290 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:37.706882 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-a374b832-006f-4898-a3fe-e647d9ad0290 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] [instance: d9988bfe-afac-40fa-ad73-2db57dadf545] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:37.712973 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a374b832-006f-4898-a3fe-e647d9ad0290 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:37.713425 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a374b832-006f-4898-a3fe-e647d9ad0290 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:37.714206 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a374b832-006f-4898-a3fe-e647d9ad0290 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:37.714644 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a374b832-006f-4898-a3fe-e647d9ad0290 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:37.804421 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-a374b832-006f-4898-a3fe-e647d9ad0290 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a8e0684f10464394e4f935d687cc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efcbf12d6654bc68690363892415b77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:37.810525 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-a374b832-006f-4898-a3fe-e647d9ad0290 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.43 "GET /compute/v2.1/servers/d9988bfe-afac-40fa-ad73-2db57dadf545" status: 200 len: 1346 microversion: 2.1 time: 0.109018 Dec 14 03:15:37.821352 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 90/177] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:15:37 2021] GET /compute/v2.1/servers/d9988bfe-afac-40fa-ad73-2db57dadf545 => generated 1346 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 03:15:37.821678 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-3a2869b0-1260-48c4-99e5-517f749a8ef5 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:37.822375 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-3a2869b0-1260-48c4-99e5-517f749a8ef5 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: c6283570-4ee2-47bc-b58a-fbfe57acbcde] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:37.829846 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3a2869b0-1260-48c4-99e5-517f749a8ef5 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:37.830362 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3a2869b0-1260-48c4-99e5-517f749a8ef5 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:37.831933 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3a2869b0-1260-48c4-99e5-517f749a8ef5 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:37.832437 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3a2869b0-1260-48c4-99e5-517f749a8ef5 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:38.017713 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-3a2869b0-1260-48c4-99e5-517f749a8ef5 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:38.030359 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-3a2869b0-1260-48c4-99e5-517f749a8ef5 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde" status: 200 len: 1522 microversion: 2.1 time: 0.212383 Dec 14 03:15:38.033899 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 88/178] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:15:37 2021] GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde => generated 1522 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:15:38.120010 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-1a2c77a1-6df4-450e-890b-3f4c1a57cb2a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:15:38.121199 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-1a2c77a1-6df4-450e-890b-3f4c1a57cb2a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:38.127848 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-1a2c77a1-6df4-450e-890b-3f4c1a57cb2a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:38.128927 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-1a2c77a1-6df4-450e-890b-3f4c1a57cb2a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:38.129950 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-1a2c77a1-6df4-450e-890b-3f4c1a57cb2a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:38.131060 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-1a2c77a1-6df4-450e-890b-3f4c1a57cb2a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:38.292133 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-1a2c77a1-6df4-450e-890b-3f4c1a57cb2a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action" status: 200 len: 14 microversion: 2.20 time: 0.175460 Dec 14 03:15:38.292785 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 91/179] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:15:38 2021] POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action => generated 14 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:15:38.458226 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-22f55d2b-dd45-497b-9016-3aae84f0372f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:15:38.459538 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-22f55d2b-dd45-497b-9016-3aae84f0372f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:38.470318 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-22f55d2b-dd45-497b-9016-3aae84f0372f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:38.471180 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-22f55d2b-dd45-497b-9016-3aae84f0372f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:38.472236 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-22f55d2b-dd45-497b-9016-3aae84f0372f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:38.472650 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-22f55d2b-dd45-497b-9016-3aae84f0372f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:38.595530 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-cda3443c-3a09-4905-9474-1242acf06ed2 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:38.596246 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-cda3443c-3a09-4905-9474-1242acf06ed2 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] [instance: ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:38.602880 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-cda3443c-3a09-4905-9474-1242acf06ed2 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:38.603527 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-cda3443c-3a09-4905-9474-1242acf06ed2 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:38.604498 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-cda3443c-3a09-4905-9474-1242acf06ed2 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:38.604934 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-cda3443c-3a09-4905-9474-1242acf06ed2 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:38.646270 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-22f55d2b-dd45-497b-9016-3aae84f0372f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action" status: 200 len: 14 microversion: 2.1 time: 0.191055 Dec 14 03:15:38.647000 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 89/180] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:15:38 2021] POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action => generated 14 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 14 03:15:38.794520 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-cda3443c-3a09-4905-9474-1242acf06ed2 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f5b824c4204f5da272b60d907bb2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722b58145d434e1181ebd90e63eb1255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:38.803799 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-cda3443c-3a09-4905-9474-1242acf06ed2 tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] 10.222.0.43 "GET /compute/v2.1/servers/ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d" status: 200 len: 1470 microversion: 2.1 time: 0.212094 Dec 14 03:15:38.804695 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 92/181] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:15:38 2021] GET /compute/v2.1/servers/ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d => generated 1470 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 03:15:38.829192 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-74995e25-d63a-4601-8fab-93c84fdb9806 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:38.830098 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-74995e25-d63a-4601-8fab-93c84fdb9806 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] [instance: d9988bfe-afac-40fa-ad73-2db57dadf545] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:38.838081 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-74995e25-d63a-4601-8fab-93c84fdb9806 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:38.838526 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-74995e25-d63a-4601-8fab-93c84fdb9806 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:38.839341 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-74995e25-d63a-4601-8fab-93c84fdb9806 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:38.839936 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-74995e25-d63a-4601-8fab-93c84fdb9806 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:38.871401 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-74995e25-d63a-4601-8fab-93c84fdb9806 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:38.871845 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-74995e25-d63a-4601-8fab-93c84fdb9806 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:38.872312 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.objects.instance [None req-74995e25-d63a-4601-8fab-93c84fdb9806 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lazy-loading 'fault' on Instance uuid d9988bfe-afac-40fa-ad73-2db57dadf545 {{(pid=116072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 14 03:15:38.917643 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-74995e25-d63a-4601-8fab-93c84fdb9806 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a8e0684f10464394e4f935d687cc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efcbf12d6654bc68690363892415b77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:38.929530 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-74995e25-d63a-4601-8fab-93c84fdb9806 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.43 "GET /compute/v2.1/servers/d9988bfe-afac-40fa-ad73-2db57dadf545" status: 200 len: 1351 microversion: 2.1 time: 0.104488 Dec 14 03:15:38.930465 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 90/182] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:15:38 2021] GET /compute/v2.1/servers/d9988bfe-afac-40fa-ad73-2db57dadf545 => generated 1351 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:15:39.050784 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-2c6799df-edab-48fb-aab8-7cae7ef2a5ad tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:39.051525 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-2c6799df-edab-48fb-aab8-7cae7ef2a5ad tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: c6283570-4ee2-47bc-b58a-fbfe57acbcde] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:39.067198 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-2c6799df-edab-48fb-aab8-7cae7ef2a5ad tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:39.067667 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-2c6799df-edab-48fb-aab8-7cae7ef2a5ad tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:39.068477 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-2c6799df-edab-48fb-aab8-7cae7ef2a5ad tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:39.069195 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-2c6799df-edab-48fb-aab8-7cae7ef2a5ad tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:39.220945 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-2c6799df-edab-48fb-aab8-7cae7ef2a5ad tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:39.229613 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-2c6799df-edab-48fb-aab8-7cae7ef2a5ad tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde" status: 200 len: 1522 microversion: 2.1 time: 0.183206 Dec 14 03:15:39.239769 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 93/183] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:15:39 2021] GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:15:39.302594 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-cb51d66a-bd33-463a-bbae-6605784271ed tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:15:39.303536 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-cb51d66a-bd33-463a-bbae-6605784271ed tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:39.310470 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-cb51d66a-bd33-463a-bbae-6605784271ed tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:39.310928 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-cb51d66a-bd33-463a-bbae-6605784271ed tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:39.311780 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-cb51d66a-bd33-463a-bbae-6605784271ed tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:39.313094 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-cb51d66a-bd33-463a-bbae-6605784271ed tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:39.434180 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-cb51d66a-bd33-463a-bbae-6605784271ed tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action" status: 200 len: 14 microversion: 2.20 time: 0.135161 Dec 14 03:15:39.435718 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 91/184] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:15:39 2021] POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action => generated 14 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:15:39.657389 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-b34c248f-99b6-4ff8-afd6-894983bbbf44 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:15:39.658415 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-b34c248f-99b6-4ff8-afd6-894983bbbf44 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:39.667225 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b34c248f-99b6-4ff8-afd6-894983bbbf44 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:39.667618 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b34c248f-99b6-4ff8-afd6-894983bbbf44 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:39.669108 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b34c248f-99b6-4ff8-afd6-894983bbbf44 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:39.669566 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b34c248f-99b6-4ff8-afd6-894983bbbf44 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:39.793084 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-b34c248f-99b6-4ff8-afd6-894983bbbf44 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action" status: 200 len: 14 microversion: 2.1 time: 0.139118 Dec 14 03:15:39.796405 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 94/185] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:15:39 2021] POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action => generated 14 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 14 03:15:39.827364 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-5ffac28e-4b84-44b0-b2e8-9a77281b82ea tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:39.831639 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-5ffac28e-4b84-44b0-b2e8-9a77281b82ea tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] [instance: ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:39.868485 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5ffac28e-4b84-44b0-b2e8-9a77281b82ea tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:39.868953 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5ffac28e-4b84-44b0-b2e8-9a77281b82ea tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:39.870385 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5ffac28e-4b84-44b0-b2e8-9a77281b82ea tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:39.873248 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5ffac28e-4b84-44b0-b2e8-9a77281b82ea tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:39.897082 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [req-0c1c0048-3f73-47da-8919-7c0201cd4833 req-6b39c5ea-8c99-4d8f-bf4c-182ef14862a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d", "name": "network-vif-deleted", "tag": "8512939b-7934-497d-9e64-85606ebc8347"}]} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:15:39.898626 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:15:39.898626 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: warnings.warn(msg) Dec 14 03:15:39.917234 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [req-0c1c0048-3f73-47da-8919-7c0201cd4833 req-6b39c5ea-8c99-4d8f-bf4c-182ef14862a8 service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:39.922625 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [req-0c1c0048-3f73-47da-8919-7c0201cd4833 req-6b39c5ea-8c99-4d8f-bf4c-182ef14862a8 service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:39.943597 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.compute.server_external_events [req-0c1c0048-3f73-47da-8919-7c0201cd4833 req-6b39c5ea-8c99-4d8f-bf4c-182ef14862a8 service nova] Creating event network-vif-deleted:8512939b-7934-497d-9e64-85606ebc8347 for instance ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d on hv-cinder-81803 Dec 14 03:15:39.952450 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [req-0c1c0048-3f73-47da-8919-7c0201cd4833 req-6b39c5ea-8c99-4d8f-bf4c-182ef14862a8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059778 Dec 14 03:15:39.956500 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 95/186] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Dec 14 03:15:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 14 03:15:39.961512 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-004c8e63-d394-41fb-989f-59a2d25b811b tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:39.962212 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-004c8e63-d394-41fb-989f-59a2d25b811b tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] [instance: d9988bfe-afac-40fa-ad73-2db57dadf545] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:39.971214 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-004c8e63-d394-41fb-989f-59a2d25b811b tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:39.971653 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-004c8e63-d394-41fb-989f-59a2d25b811b tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:39.973243 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-004c8e63-d394-41fb-989f-59a2d25b811b tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:39.973690 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-004c8e63-d394-41fb-989f-59a2d25b811b tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:39.996940 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-5ffac28e-4b84-44b0-b2e8-9a77281b82ea tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f5b824c4204f5da272b60d907bb2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722b58145d434e1181ebd90e63eb1255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:40.022820 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-5ffac28e-4b84-44b0-b2e8-9a77281b82ea tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] 10.222.0.43 "GET /compute/v2.1/servers/ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d" status: 200 len: 1428 microversion: 2.1 time: 0.205287 Dec 14 03:15:40.024801 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 92/187] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:15:39 2021] GET /compute/v2.1/servers/ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d => generated 1428 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:15:40.036800 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.wsgi [None req-004c8e63-d394-41fb-989f-59a2d25b811b tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] HTTP exception thrown: Instance d9988bfe-afac-40fa-ad73-2db57dadf545 could not be found. Dec 14 03:15:40.044965 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-004c8e63-d394-41fb-989f-59a2d25b811b tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Returning 404 to user: Instance d9988bfe-afac-40fa-ad73-2db57dadf545 could not be found. {{(pid=116071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 03:15:40.046201 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-004c8e63-d394-41fb-989f-59a2d25b811b tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.43 "GET /compute/v2.1/servers/d9988bfe-afac-40fa-ad73-2db57dadf545" status: 404 len: 111 microversion: 2.1 time: 0.088266 Dec 14 03:15:40.046947 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 96/188] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:15:39 2021] GET /compute/v2.1/servers/d9988bfe-afac-40fa-ad73-2db57dadf545 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 14 03:15:40.217844 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-9124182c-cbc4-4294-aef5-0f4e486d42f4 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:40.219171 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-9124182c-cbc4-4294-aef5-0f4e486d42f4 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] [instance: d9988bfe-afac-40fa-ad73-2db57dadf545] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:40.227124 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9124182c-cbc4-4294-aef5-0f4e486d42f4 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:40.227906 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9124182c-cbc4-4294-aef5-0f4e486d42f4 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:40.228906 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9124182c-cbc4-4294-aef5-0f4e486d42f4 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:40.229358 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9124182c-cbc4-4294-aef5-0f4e486d42f4 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:40.256971 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-2e2054e8-6bdd-4f01-8e78-9b943ac2a6a3 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:40.257591 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-2e2054e8-6bdd-4f01-8e78-9b943ac2a6a3 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: c6283570-4ee2-47bc-b58a-fbfe57acbcde] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:40.263607 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-2e2054e8-6bdd-4f01-8e78-9b943ac2a6a3 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:40.264067 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-2e2054e8-6bdd-4f01-8e78-9b943ac2a6a3 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:40.264860 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-2e2054e8-6bdd-4f01-8e78-9b943ac2a6a3 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:40.265309 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-2e2054e8-6bdd-4f01-8e78-9b943ac2a6a3 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:40.267563 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.wsgi [None req-9124182c-cbc4-4294-aef5-0f4e486d42f4 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] HTTP exception thrown: Instance d9988bfe-afac-40fa-ad73-2db57dadf545 could not be found. Dec 14 03:15:40.268163 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-9124182c-cbc4-4294-aef5-0f4e486d42f4 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Returning 404 to user: Instance d9988bfe-afac-40fa-ad73-2db57dadf545 could not be found. {{(pid=116072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 03:15:40.269524 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-9124182c-cbc4-4294-aef5-0f4e486d42f4 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.43 "GET /compute/v2.1/servers/d9988bfe-afac-40fa-ad73-2db57dadf545/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.054961 Dec 14 03:15:40.270085 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 93/189] 10.222.0.43 () {58 vars in 1301 bytes} [Tue Dec 14 03:15:40 2021] GET /compute/v2.1/servers/d9988bfe-afac-40fa-ad73-2db57dadf545/os-volume_attachments => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 14 03:15:40.445419 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-68b11c0c-24cf-44d3-9921-6dc4f6d4ada1 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:15:40.446336 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-68b11c0c-24cf-44d3-9921-6dc4f6d4ada1 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:40.452733 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-68b11c0c-24cf-44d3-9921-6dc4f6d4ada1 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:40.453185 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-68b11c0c-24cf-44d3-9921-6dc4f6d4ada1 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:40.453978 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-68b11c0c-24cf-44d3-9921-6dc4f6d4ada1 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:40.454414 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-68b11c0c-24cf-44d3-9921-6dc4f6d4ada1 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:40.553101 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-2e2054e8-6bdd-4f01-8e78-9b943ac2a6a3 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:40.567155 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-2e2054e8-6bdd-4f01-8e78-9b943ac2a6a3 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde" status: 200 len: 1522 microversion: 2.1 time: 0.321718 Dec 14 03:15:40.568893 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 97/190] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:15:40 2021] GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde => generated 1522 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 03:15:40.598733 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-68b11c0c-24cf-44d3-9921-6dc4f6d4ada1 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action" status: 200 len: 14 microversion: 2.20 time: 0.156498 Dec 14 03:15:40.599460 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 94/191] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:15:40 2021] POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action => generated 14 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 03:15:40.805171 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-b9a06f49-c514-43e3-a9a2-e963591c151c tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:15:40.806088 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-b9a06f49-c514-43e3-a9a2-e963591c151c tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:40.812448 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b9a06f49-c514-43e3-a9a2-e963591c151c tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:40.812904 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b9a06f49-c514-43e3-a9a2-e963591c151c tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:40.813681 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b9a06f49-c514-43e3-a9a2-e963591c151c tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:40.814120 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b9a06f49-c514-43e3-a9a2-e963591c151c tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:40.911547 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-b9a06f49-c514-43e3-a9a2-e963591c151c tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action" status: 200 len: 14 microversion: 2.1 time: 0.109777 Dec 14 03:15:40.912323 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 98/192] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:15:40 2021] POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action => generated 14 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 14 03:15:41.041403 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-e04ad07a-0b31-455b-b999-71aec13bdbcf tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:41.042091 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-e04ad07a-0b31-455b-b999-71aec13bdbcf tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] [instance: ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:41.048872 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e04ad07a-0b31-455b-b999-71aec13bdbcf tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:41.049322 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e04ad07a-0b31-455b-b999-71aec13bdbcf tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:41.050090 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e04ad07a-0b31-455b-b999-71aec13bdbcf tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:41.050525 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e04ad07a-0b31-455b-b999-71aec13bdbcf tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:41.063570 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.wsgi [None req-e04ad07a-0b31-455b-b999-71aec13bdbcf tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] HTTP exception thrown: Instance ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d could not be found. Dec 14 03:15:41.064143 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-e04ad07a-0b31-455b-b999-71aec13bdbcf tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] Returning 404 to user: Instance ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d could not be found. {{(pid=116072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 03:15:41.064934 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-e04ad07a-0b31-455b-b999-71aec13bdbcf tempest-VolumesNegativeTest-1804437456 tempest-VolumesNegativeTest-1804437456-project] 10.222.0.43 "GET /compute/v2.1/servers/ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d" status: 404 len: 111 microversion: 2.1 time: 0.027509 Dec 14 03:15:41.065434 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 95/193] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:15:41 2021] GET /compute/v2.1/servers/ea91dda9-5c6e-4cd7-a2d8-8a8436dea80d => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 14 03:15:41.504077 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-889631da-56b8-40d9-b6f9-f50c52822c84 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:41.504661 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-889631da-56b8-40d9-b6f9-f50c52822c84 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] [instance: d9988bfe-afac-40fa-ad73-2db57dadf545] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:41.511786 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-889631da-56b8-40d9-b6f9-f50c52822c84 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:41.512304 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-889631da-56b8-40d9-b6f9-f50c52822c84 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:41.513315 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-889631da-56b8-40d9-b6f9-f50c52822c84 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:41.513762 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-889631da-56b8-40d9-b6f9-f50c52822c84 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:41.529359 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.wsgi [None req-889631da-56b8-40d9-b6f9-f50c52822c84 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] HTTP exception thrown: Instance d9988bfe-afac-40fa-ad73-2db57dadf545 could not be found. Dec 14 03:15:41.529949 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-889631da-56b8-40d9-b6f9-f50c52822c84 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Returning 404 to user: Instance d9988bfe-afac-40fa-ad73-2db57dadf545 could not be found. {{(pid=116071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 03:15:41.530773 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-889631da-56b8-40d9-b6f9-f50c52822c84 tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.43 "DELETE /compute/v2.1/servers/d9988bfe-afac-40fa-ad73-2db57dadf545" status: 404 len: 111 microversion: 2.1 time: 0.031137 Dec 14 03:15:41.531341 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 99/194] 10.222.0.43 () {58 vars in 1238 bytes} [Tue Dec 14 03:15:41 2021] DELETE /compute/v2.1/servers/d9988bfe-afac-40fa-ad73-2db57dadf545 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 14 03:15:41.539147 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-63e33534-8893-4995-bde8-6890ed5511ed tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:41.539764 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-63e33534-8893-4995-bde8-6890ed5511ed tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] [instance: d9988bfe-afac-40fa-ad73-2db57dadf545] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:41.546025 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-63e33534-8893-4995-bde8-6890ed5511ed tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:41.546477 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-63e33534-8893-4995-bde8-6890ed5511ed tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:41.547276 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-63e33534-8893-4995-bde8-6890ed5511ed tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:41.547704 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-63e33534-8893-4995-bde8-6890ed5511ed tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:41.560368 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.wsgi [None req-63e33534-8893-4995-bde8-6890ed5511ed tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] HTTP exception thrown: Instance d9988bfe-afac-40fa-ad73-2db57dadf545 could not be found. Dec 14 03:15:41.560936 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-63e33534-8893-4995-bde8-6890ed5511ed tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] Returning 404 to user: Instance d9988bfe-afac-40fa-ad73-2db57dadf545 could not be found. {{(pid=116072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 03:15:41.561721 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-63e33534-8893-4995-bde8-6890ed5511ed tempest-DeleteServersTestJSON-1894044193 tempest-DeleteServersTestJSON-1894044193-project] 10.222.0.43 "GET /compute/v2.1/servers/d9988bfe-afac-40fa-ad73-2db57dadf545" status: 404 len: 111 microversion: 2.1 time: 0.026311 Dec 14 03:15:41.562221 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 96/195] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:15:41 2021] GET /compute/v2.1/servers/d9988bfe-afac-40fa-ad73-2db57dadf545 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 14 03:15:41.585125 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-fbcc8a5b-9299-43bc-a4c9-3b2dc24e4aae tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:41.585741 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-fbcc8a5b-9299-43bc-a4c9-3b2dc24e4aae tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: c6283570-4ee2-47bc-b58a-fbfe57acbcde] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:41.592018 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-fbcc8a5b-9299-43bc-a4c9-3b2dc24e4aae tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:41.592474 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-fbcc8a5b-9299-43bc-a4c9-3b2dc24e4aae tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:41.593263 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-fbcc8a5b-9299-43bc-a4c9-3b2dc24e4aae tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:41.593704 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-fbcc8a5b-9299-43bc-a4c9-3b2dc24e4aae tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:41.609983 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-0bad58ff-94a8-4eab-b82c-b74be98ead8c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:15:41.610998 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-0bad58ff-94a8-4eab-b82c-b74be98ead8c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:41.618275 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0bad58ff-94a8-4eab-b82c-b74be98ead8c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:41.618791 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0bad58ff-94a8-4eab-b82c-b74be98ead8c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:41.619658 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0bad58ff-94a8-4eab-b82c-b74be98ead8c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:41.620201 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0bad58ff-94a8-4eab-b82c-b74be98ead8c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:41.736159 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-fbcc8a5b-9299-43bc-a4c9-3b2dc24e4aae tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:41.746555 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-fbcc8a5b-9299-43bc-a4c9-3b2dc24e4aae tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde" status: 200 len: 1522 microversion: 2.1 time: 0.165476 Dec 14 03:15:41.756715 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 100/196] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:15:41 2021] GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:15:41.756885 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-0bad58ff-94a8-4eab-b82c-b74be98ead8c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action" status: 200 len: 14 microversion: 2.20 time: 0.141833 Dec 14 03:15:41.756885 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 97/197] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:15:41 2021] POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action => generated 14 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 03:15:41.921917 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-8c560004-c2af-4361-a697-7d04698af72a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:15:41.923018 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-8c560004-c2af-4361-a697-7d04698af72a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:41.930904 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-8c560004-c2af-4361-a697-7d04698af72a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:41.931405 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-8c560004-c2af-4361-a697-7d04698af72a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:41.932200 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-8c560004-c2af-4361-a697-7d04698af72a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:41.932638 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-8c560004-c2af-4361-a697-7d04698af72a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:42.759888 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-5e3b8608-efce-469d-ba39-92024b97bdb2 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:15:42.760885 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-5e3b8608-efce-469d-ba39-92024b97bdb2 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:42.767825 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5e3b8608-efce-469d-ba39-92024b97bdb2 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:42.768270 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5e3b8608-efce-469d-ba39-92024b97bdb2 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:42.769617 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5e3b8608-efce-469d-ba39-92024b97bdb2 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:42.770050 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5e3b8608-efce-469d-ba39-92024b97bdb2 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:51.692842 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-5e3b8608-efce-469d-ba39-92024b97bdb2 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action" status: 200 len: 24792 microversion: 2.20 time: 8.936439 Dec 14 03:15:51.693795 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 98/198] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:15:42 2021] POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action => generated 24792 bytes in 8939 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 14 03:15:51.698555 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-70194c39-1fd0-42c7-9b89-0daf16648449 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:51.699320 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-70194c39-1fd0-42c7-9b89-0daf16648449 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: c6283570-4ee2-47bc-b58a-fbfe57acbcde] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:51.706660 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-70194c39-1fd0-42c7-9b89-0daf16648449 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:51.707070 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-70194c39-1fd0-42c7-9b89-0daf16648449 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:51.707987 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-70194c39-1fd0-42c7-9b89-0daf16648449 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:51.708636 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-70194c39-1fd0-42c7-9b89-0daf16648449 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:51.728353 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-8c560004-c2af-4361-a697-7d04698af72a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action" status: 200 len: 14 microversion: 2.1 time: 9.809952 Dec 14 03:15:51.729411 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 101/199] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:15:41 2021] POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action => generated 14 bytes in 9812 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 14 03:15:51.873086 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-70194c39-1fd0-42c7-9b89-0daf16648449 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:51.880755 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-70194c39-1fd0-42c7-9b89-0daf16648449 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde" status: 200 len: 1522 microversion: 2.1 time: 0.185827 Dec 14 03:15:51.881319 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 99/200] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:15:51 2021] GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:15:51.888925 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-e8e09358-7dfd-4938-81f1-3ac13c621f0c tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-939319173", "imageRef": "4fff76a9-6620-4bda-b1ec-2cd3719c946a", "flavorRef": "452", "networks": [{"uuid": "69a3889e-636a-4983-9398-edafd7db5301"}]}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:15:51.945323 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.network.neutron [None req-e8e09358-7dfd-4938-81f1-3ac13c621f0c tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] validate_networks() for [('69a3889e-636a-4983-9398-edafd7db5301', None, None, None, None, None)] {{(pid=116071) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 14 03:15:52.272797 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.virt.hardware [None req-e8e09358-7dfd-4938-81f1-3ac13c621f0c tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Flavor limits 0:0:0 {{(pid=116071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 14 03:15:52.273219 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.virt.hardware [None req-e8e09358-7dfd-4938-81f1-3ac13c621f0c tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Image limits 0:0:0 {{(pid=116071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 14 03:15:52.273686 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.virt.hardware [None req-e8e09358-7dfd-4938-81f1-3ac13c621f0c tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Flavor pref 0:0:0 {{(pid=116071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 14 03:15:52.274088 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.virt.hardware [None req-e8e09358-7dfd-4938-81f1-3ac13c621f0c tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Image pref 0:0:0 {{(pid=116071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 14 03:15:52.274492 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.virt.hardware [None req-e8e09358-7dfd-4938-81f1-3ac13c621f0c tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 14 03:15:52.282863 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-e8e09358-7dfd-4938-81f1-3ac13c621f0c tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:52.283337 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-e8e09358-7dfd-4938-81f1-3ac13c621f0c tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:52.284147 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-e8e09358-7dfd-4938-81f1-3ac13c621f0c tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:52.284578 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-e8e09358-7dfd-4938-81f1-3ac13c621f0c tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:52.302801 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.quota [None req-e8e09358-7dfd-4938-81f1-3ac13c621f0c tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Getting quotas for project 7ecea5c13a624ab8a3a445d3ede5fd77. Resources: {'cores', 'instances', 'ram'} {{(pid=116071) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 03:15:52.306612 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.quota [None req-e8e09358-7dfd-4938-81f1-3ac13c621f0c tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Getting quotas for user 0a133cb1175e4130902bbcdeaedd74f9 and project 7ecea5c13a624ab8a3a445d3ede5fd77. Resources: {'cores', 'instances', 'ram'} {{(pid=116071) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 03:15:52.317486 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-e8e09358-7dfd-4938-81f1-3ac13c621f0c tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Going to run 1 instances... {{(pid=116071) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 14 03:15:52.319879 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-e8e09358-7dfd-4938-81f1-3ac13c621f0c tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: de04da40-f5fd-43e2-b454-20a219642030] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4fff76a9-6620-4bda-b1ec-2cd3719c946a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 14 03:15:52.366089 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-e8e09358-7dfd-4938-81f1-3ac13c621f0c tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.634746 Dec 14 03:15:52.366851 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 102/201] 10.222.0.43 () {60 vars in 1146 bytes} [Tue Dec 14 03:15:51 2021] POST /compute/v2.1/servers => generated 380 bytes in 636 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 14 03:15:52.376944 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-3b8337bb-dced-4759-86f1-30bbcd0093e6 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:52.377559 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-3b8337bb-dced-4759-86f1-30bbcd0093e6 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: de04da40-f5fd-43e2-b454-20a219642030] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:52.430403 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-3b8337bb-dced-4759-86f1-30bbcd0093e6 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:52.437463 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-3b8337bb-dced-4759-86f1-30bbcd0093e6 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030" status: 200 len: 1217 microversion: 2.1 time: 0.064104 Dec 14 03:15:52.438041 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 100/202] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:15:52 2021] GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030 => generated 1217 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:15:52.704213 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-aa222ca3-497c-41dc-94ce-0260a9990814 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:15:52.705196 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-aa222ca3-497c-41dc-94ce-0260a9990814 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:52.712124 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-aa222ca3-497c-41dc-94ce-0260a9990814 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:52.712580 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-aa222ca3-497c-41dc-94ce-0260a9990814 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:52.713371 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-aa222ca3-497c-41dc-94ce-0260a9990814 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:52.713812 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-aa222ca3-497c-41dc-94ce-0260a9990814 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:52.740271 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-a4ed138b-e593-49a2-a4bd-ce51af05f84e tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:15:52.741246 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-a4ed138b-e593-49a2-a4bd-ce51af05f84e tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:52.748613 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a4ed138b-e593-49a2-a4bd-ce51af05f84e tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:52.749144 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a4ed138b-e593-49a2-a4bd-ce51af05f84e tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:52.749928 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a4ed138b-e593-49a2-a4bd-ce51af05f84e tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:52.750357 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a4ed138b-e593-49a2-a4bd-ce51af05f84e tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:52.892377 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-aa222ca3-497c-41dc-94ce-0260a9990814 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action" status: 200 len: 25990 microversion: 2.20 time: 0.191640 Dec 14 03:15:52.893028 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 103/203] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:15:52 2021] POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action => generated 25990 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:15:52.898443 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-2e8b7be0-5a0c-4242-8b40-753e5efc8b55 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:52.899237 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-2e8b7be0-5a0c-4242-8b40-753e5efc8b55 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: c6283570-4ee2-47bc-b58a-fbfe57acbcde] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:52.906314 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-2e8b7be0-5a0c-4242-8b40-753e5efc8b55 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:52.906778 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-2e8b7be0-5a0c-4242-8b40-753e5efc8b55 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:52.907646 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-2e8b7be0-5a0c-4242-8b40-753e5efc8b55 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:52.908086 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-2e8b7be0-5a0c-4242-8b40-753e5efc8b55 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:52.926424 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-a4ed138b-e593-49a2-a4bd-ce51af05f84e tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action" status: 200 len: 14 microversion: 2.1 time: 0.190256 Dec 14 03:15:52.927068 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 101/204] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:15:52 2021] POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action => generated 14 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 14 03:15:53.050386 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-2e8b7be0-5a0c-4242-8b40-753e5efc8b55 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:53.059006 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-2e8b7be0-5a0c-4242-8b40-753e5efc8b55 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde" status: 200 len: 1522 microversion: 2.1 time: 0.164702 Dec 14 03:15:53.059684 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 104/205] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:15:52 2021] GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:15:53.455878 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-cd4ad081-6a83-491f-b768-20f112ab0bb0 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:53.456963 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-cd4ad081-6a83-491f-b768-20f112ab0bb0 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: de04da40-f5fd-43e2-b454-20a219642030] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:53.470308 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-cd4ad081-6a83-491f-b768-20f112ab0bb0 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:53.471313 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-cd4ad081-6a83-491f-b768-20f112ab0bb0 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:53.472099 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-cd4ad081-6a83-491f-b768-20f112ab0bb0 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:53.472527 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-cd4ad081-6a83-491f-b768-20f112ab0bb0 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:53.538603 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-cd4ad081-6a83-491f-b768-20f112ab0bb0 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:53.550719 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-cd4ad081-6a83-491f-b768-20f112ab0bb0 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030" status: 200 len: 1269 microversion: 2.1 time: 0.098479 Dec 14 03:15:53.552531 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 102/206] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:15:53 2021] GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030 => generated 1269 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:15:53.909845 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-be4aaf73-153a-4cfd-8963-fa5f029483d2 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:15:53.911735 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-be4aaf73-153a-4cfd-8963-fa5f029483d2 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:53.920886 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-be4aaf73-153a-4cfd-8963-fa5f029483d2 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:53.921508 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-be4aaf73-153a-4cfd-8963-fa5f029483d2 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:53.922331 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-be4aaf73-153a-4cfd-8963-fa5f029483d2 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:53.922780 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-be4aaf73-153a-4cfd-8963-fa5f029483d2 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:53.938477 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-6de57024-0b6b-4daa-9a0a-e823364a2d47 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:15:53.939564 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-6de57024-0b6b-4daa-9a0a-e823364a2d47 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:53.947334 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6de57024-0b6b-4daa-9a0a-e823364a2d47 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:53.948104 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6de57024-0b6b-4daa-9a0a-e823364a2d47 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:53.949153 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6de57024-0b6b-4daa-9a0a-e823364a2d47 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:53.949694 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6de57024-0b6b-4daa-9a0a-e823364a2d47 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:59.556307 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-be4aaf73-153a-4cfd-8963-fa5f029483d2 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action" status: 200 len: 27760 microversion: 2.20 time: 5.655344 Dec 14 03:15:59.560498 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 105/207] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:15:53 2021] POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action => generated 27760 bytes in 5657 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:15:59.561874 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-8876ea8b-2601-4585-953f-173791efac5d tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:59.562606 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-8876ea8b-2601-4585-953f-173791efac5d tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: c6283570-4ee2-47bc-b58a-fbfe57acbcde] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:59.570347 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-8876ea8b-2601-4585-953f-173791efac5d tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:59.570801 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-8876ea8b-2601-4585-953f-173791efac5d tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:59.571777 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-8876ea8b-2601-4585-953f-173791efac5d tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:59.572225 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-8876ea8b-2601-4585-953f-173791efac5d tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:59.588810 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-6de57024-0b6b-4daa-9a0a-e823364a2d47 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action" status: 200 len: 22266 microversion: 2.1 time: 5.655231 Dec 14 03:15:59.592821 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 103/208] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:15:53 2021] POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action => generated 22266 bytes in 5658 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 14 03:15:59.595334 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-d93b477b-6e2e-4c82-8ddd-b5864361c8cd tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:15:59.596021 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-d93b477b-6e2e-4c82-8ddd-b5864361c8cd tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: de04da40-f5fd-43e2-b454-20a219642030] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:15:59.610520 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d93b477b-6e2e-4c82-8ddd-b5864361c8cd tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:59.610968 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d93b477b-6e2e-4c82-8ddd-b5864361c8cd tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:59.611803 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d93b477b-6e2e-4c82-8ddd-b5864361c8cd tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:15:59.612235 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d93b477b-6e2e-4c82-8ddd-b5864361c8cd tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:15:59.742351 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-8876ea8b-2601-4585-953f-173791efac5d tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:59.751532 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-8876ea8b-2601-4585-953f-173791efac5d tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde" status: 200 len: 1522 microversion: 2.1 time: 0.193358 Dec 14 03:15:59.760145 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 106/209] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:15:59 2021] GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:15:59.803202 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-d93b477b-6e2e-4c82-8ddd-b5864361c8cd tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:15:59.810415 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-d93b477b-6e2e-4c82-8ddd-b5864361c8cd tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030" status: 200 len: 1317 microversion: 2.1 time: 0.218827 Dec 14 03:15:59.810967 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 104/210] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:15:59 2021] GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030 => generated 1317 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:16:00.095602 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [req-be67c5cd-31f6-473e-9de6-bf1ee1db5dde req-a1aff381-7127-4436-886f-52ef096d7259 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de04da40-f5fd-43e2-b454-20a219642030", "tag": "b60f528b-8a43-4d0c-83ea-77e6e41b0fe5"}]} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:16:00.097108 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:16:00.097108 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: warnings.warn(msg) Dec 14 03:16:00.104241 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [req-be67c5cd-31f6-473e-9de6-bf1ee1db5dde req-a1aff381-7127-4436-886f-52ef096d7259 service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:00.104682 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [req-be67c5cd-31f6-473e-9de6-bf1ee1db5dde req-a1aff381-7127-4436-886f-52ef096d7259 service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:00.115495 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.compute.server_external_events [req-be67c5cd-31f6-473e-9de6-bf1ee1db5dde req-a1aff381-7127-4436-886f-52ef096d7259 service nova] Creating event network-changed:b60f528b-8a43-4d0c-83ea-77e6e41b0fe5 for instance de04da40-f5fd-43e2-b454-20a219642030 on hv-cinder-81803 Dec 14 03:16:00.119959 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [req-be67c5cd-31f6-473e-9de6-bf1ee1db5dde req-a1aff381-7127-4436-886f-52ef096d7259 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028055 Dec 14 03:16:00.120538 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 107/211] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Dec 14 03:16:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:16:00.568296 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-c5064bb6-ad7e-4890-801d-699b220cf72b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:16:00.569504 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-c5064bb6-ad7e-4890-801d-699b220cf72b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:16:00.575669 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c5064bb6-ad7e-4890-801d-699b220cf72b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:00.576123 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c5064bb6-ad7e-4890-801d-699b220cf72b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:00.576908 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c5064bb6-ad7e-4890-801d-699b220cf72b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:00.577346 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c5064bb6-ad7e-4890-801d-699b220cf72b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:00.602332 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-dc93c5ef-aabf-4eea-a72e-fae1515868dd tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:16:00.604110 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-dc93c5ef-aabf-4eea-a72e-fae1515868dd tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:16:00.611031 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-dc93c5ef-aabf-4eea-a72e-fae1515868dd tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:00.611593 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-dc93c5ef-aabf-4eea-a72e-fae1515868dd tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:00.612517 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-dc93c5ef-aabf-4eea-a72e-fae1515868dd tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:00.613826 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-dc93c5ef-aabf-4eea-a72e-fae1515868dd tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:00.715360 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-c5064bb6-ad7e-4890-801d-699b220cf72b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action" status: 200 len: 27825 microversion: 2.20 time: 0.151187 Dec 14 03:16:00.716257 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 105/212] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:16:00 2021] POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action => generated 27825 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:16:00.768763 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-79b2baa4-cc77-43b1-af63-af6c2f7f8ca3 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:16:00.769453 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-79b2baa4-cc77-43b1-af63-af6c2f7f8ca3 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: c6283570-4ee2-47bc-b58a-fbfe57acbcde] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:16:00.776333 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-79b2baa4-cc77-43b1-af63-af6c2f7f8ca3 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:00.776782 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-79b2baa4-cc77-43b1-af63-af6c2f7f8ca3 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:00.777553 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-79b2baa4-cc77-43b1-af63-af6c2f7f8ca3 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:00.778024 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-79b2baa4-cc77-43b1-af63-af6c2f7f8ca3 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:00.910798 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-79b2baa4-cc77-43b1-af63-af6c2f7f8ca3 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:16:00.917962 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-79b2baa4-cc77-43b1-af63-af6c2f7f8ca3 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde" status: 200 len: 1522 microversion: 2.1 time: 0.153043 Dec 14 03:16:00.918550 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 106/213] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:16:00 2021] GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 03:16:00.923382 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-8aa108e1-e48f-41b6-bf7c-656506f9708f tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:16:00.924146 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-8aa108e1-e48f-41b6-bf7c-656506f9708f tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: de04da40-f5fd-43e2-b454-20a219642030] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:16:00.926728 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-dc93c5ef-aabf-4eea-a72e-fae1515868dd tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action" status: 200 len: 23803 microversion: 2.1 time: 0.328682 Dec 14 03:16:00.930615 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 108/214] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:16:00 2021] POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action => generated 23803 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 14 03:16:00.930739 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8aa108e1-e48f-41b6-bf7c-656506f9708f tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:00.930976 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8aa108e1-e48f-41b6-bf7c-656506f9708f tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:00.931774 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8aa108e1-e48f-41b6-bf7c-656506f9708f tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:00.932199 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8aa108e1-e48f-41b6-bf7c-656506f9708f tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:01.064595 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-8aa108e1-e48f-41b6-bf7c-656506f9708f tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:16:01.072629 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-8aa108e1-e48f-41b6-bf7c-656506f9708f tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030" status: 200 len: 1317 microversion: 2.1 time: 0.152929 Dec 14 03:16:01.073702 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 107/215] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:16:00 2021] GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:16:01.727539 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-9cbf0431-a664-4b0d-8fe7-6e1ad91667fa tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:16:01.728537 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-9cbf0431-a664-4b0d-8fe7-6e1ad91667fa tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:16:01.735313 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-9cbf0431-a664-4b0d-8fe7-6e1ad91667fa tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:01.735762 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-9cbf0431-a664-4b0d-8fe7-6e1ad91667fa tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:01.736530 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-9cbf0431-a664-4b0d-8fe7-6e1ad91667fa tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:01.736966 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-9cbf0431-a664-4b0d-8fe7-6e1ad91667fa tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:01.935835 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-1e7086c0-f3e9-43f2-915b-af624efcb666 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:16:01.936580 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-1e7086c0-f3e9-43f2-915b-af624efcb666 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: c6283570-4ee2-47bc-b58a-fbfe57acbcde] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:16:01.943343 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1e7086c0-f3e9-43f2-915b-af624efcb666 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:01.943822 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1e7086c0-f3e9-43f2-915b-af624efcb666 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:01.944781 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1e7086c0-f3e9-43f2-915b-af624efcb666 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:01.945223 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1e7086c0-f3e9-43f2-915b-af624efcb666 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:02.094150 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-1e7086c0-f3e9-43f2-915b-af624efcb666 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:16:02.101356 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-1e7086c0-f3e9-43f2-915b-af624efcb666 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde" status: 200 len: 1522 microversion: 2.1 time: 0.169281 Dec 14 03:16:02.101955 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 108/216] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:16:01 2021] GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 03:16:02.106093 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-ff285a52-7334-4431-95ff-bcc254191dd7 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:16:02.107120 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-ff285a52-7334-4431-95ff-bcc254191dd7 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:16:02.112707 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ff285a52-7334-4431-95ff-bcc254191dd7 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:02.113414 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ff285a52-7334-4431-95ff-bcc254191dd7 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:02.114783 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ff285a52-7334-4431-95ff-bcc254191dd7 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:02.115279 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ff285a52-7334-4431-95ff-bcc254191dd7 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:02.158998 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-9cbf0431-a664-4b0d-8fe7-6e1ad91667fa tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action" status: 200 len: 27952 microversion: 2.20 time: 0.435305 Dec 14 03:16:02.159970 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 109/217] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:16:01 2021] POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action => generated 27952 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:16:02.165063 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-1c33dd34-b174-417c-ac19-b86ea8668dd9 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:16:02.165765 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-1c33dd34-b174-417c-ac19-b86ea8668dd9 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: de04da40-f5fd-43e2-b454-20a219642030] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:16:02.172421 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-1c33dd34-b174-417c-ac19-b86ea8668dd9 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:02.172877 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-1c33dd34-b174-417c-ac19-b86ea8668dd9 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:02.173653 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-1c33dd34-b174-417c-ac19-b86ea8668dd9 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:02.174093 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-1c33dd34-b174-417c-ac19-b86ea8668dd9 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:02.310298 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-1c33dd34-b174-417c-ac19-b86ea8668dd9 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:16:02.317616 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-1c33dd34-b174-417c-ac19-b86ea8668dd9 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030" status: 200 len: 1317 microversion: 2.1 time: 0.156874 Dec 14 03:16:02.318177 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 110/218] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:16:02 2021] GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:16:02.320987 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-ff285a52-7334-4431-95ff-bcc254191dd7 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action" status: 200 len: 24655 microversion: 2.1 time: 0.217842 Dec 14 03:16:02.321742 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 109/219] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:16:02 2021] POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action => generated 24655 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:16:03.118376 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-42835d83-3523-48ce-97ab-c96420d07dc6 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:16:03.118986 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-42835d83-3523-48ce-97ab-c96420d07dc6 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: c6283570-4ee2-47bc-b58a-fbfe57acbcde] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:16:03.125203 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-42835d83-3523-48ce-97ab-c96420d07dc6 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:03.125653 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-42835d83-3523-48ce-97ab-c96420d07dc6 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:03.126425 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-42835d83-3523-48ce-97ab-c96420d07dc6 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:03.126862 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-42835d83-3523-48ce-97ab-c96420d07dc6 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:03.172548 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-29476184-e5ac-4671-bf6c-b2df3954a8b9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:16:03.173643 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-29476184-e5ac-4671-bf6c-b2df3954a8b9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:16:03.181842 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-29476184-e5ac-4671-bf6c-b2df3954a8b9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:03.182295 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-29476184-e5ac-4671-bf6c-b2df3954a8b9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:03.183123 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-29476184-e5ac-4671-bf6c-b2df3954a8b9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:03.183568 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-29476184-e5ac-4671-bf6c-b2df3954a8b9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:03.256155 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-42835d83-3523-48ce-97ab-c96420d07dc6 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:16:03.263427 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-42835d83-3523-48ce-97ab-c96420d07dc6 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde" status: 200 len: 1522 microversion: 2.1 time: 0.148663 Dec 14 03:16:03.263999 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 111/220] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:16:03 2021] GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:16:03.333019 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-2c67d700-16ec-481b-b328-afcd29c33f0c tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:16:03.333996 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-2c67d700-16ec-481b-b328-afcd29c33f0c tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:16:03.339810 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-2c67d700-16ec-481b-b328-afcd29c33f0c tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:03.340263 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-2c67d700-16ec-481b-b328-afcd29c33f0c tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:03.341046 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-2c67d700-16ec-481b-b328-afcd29c33f0c tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:03.341486 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-2c67d700-16ec-481b-b328-afcd29c33f0c tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:10.228121 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-29476184-e5ac-4671-bf6c-b2df3954a8b9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action" status: 200 len: 28003 microversion: 2.20 time: 7.060018 Dec 14 03:16:10.232104 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 110/221] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:16:03 2021] POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action => generated 28003 bytes in 7062 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 14 03:16:10.233747 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-c344194f-5307-477c-9d38-360d72993a38 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:16:10.234443 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-c344194f-5307-477c-9d38-360d72993a38 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: de04da40-f5fd-43e2-b454-20a219642030] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:16:10.242011 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c344194f-5307-477c-9d38-360d72993a38 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:10.242453 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c344194f-5307-477c-9d38-360d72993a38 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:10.243266 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c344194f-5307-477c-9d38-360d72993a38 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:10.243708 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c344194f-5307-477c-9d38-360d72993a38 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:10.253536 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-2c67d700-16ec-481b-b328-afcd29c33f0c tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action" status: 200 len: 27711 microversion: 2.1 time: 6.924670 Dec 14 03:16:10.257476 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 112/222] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:16:03 2021] POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action => generated 27711 bytes in 6926 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 14 03:16:10.259670 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-8536522b-1274-4b41-9ff4-abe7f280d5ef tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:16:10.260363 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-8536522b-1274-4b41-9ff4-abe7f280d5ef tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: c6283570-4ee2-47bc-b58a-fbfe57acbcde] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:16:10.267919 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-8536522b-1274-4b41-9ff4-abe7f280d5ef tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:10.268368 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-8536522b-1274-4b41-9ff4-abe7f280d5ef tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:10.269139 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-8536522b-1274-4b41-9ff4-abe7f280d5ef tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:10.269572 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-8536522b-1274-4b41-9ff4-abe7f280d5ef tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:10.440420 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-c344194f-5307-477c-9d38-360d72993a38 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:16:10.443787 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-8536522b-1274-4b41-9ff4-abe7f280d5ef tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:16:10.447869 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-c344194f-5307-477c-9d38-360d72993a38 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030" status: 200 len: 1317 microversion: 2.1 time: 0.217762 Dec 14 03:16:10.448432 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 111/223] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:16:10 2021] GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030 => generated 1317 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:16:10.451032 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-8536522b-1274-4b41-9ff4-abe7f280d5ef tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde" status: 200 len: 1522 microversion: 2.1 time: 0.195554 Dec 14 03:16:10.451608 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 113/224] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:16:10 2021] GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:16:11.240122 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-e5dd75cb-dd14-426d-9187-c7f7a49f32bd tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:16:11.241698 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-e5dd75cb-dd14-426d-9187-c7f7a49f32bd tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:16:11.249015 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e5dd75cb-dd14-426d-9187-c7f7a49f32bd tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:11.249461 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e5dd75cb-dd14-426d-9187-c7f7a49f32bd tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:11.250236 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e5dd75cb-dd14-426d-9187-c7f7a49f32bd tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:11.250667 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e5dd75cb-dd14-426d-9187-c7f7a49f32bd tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:11.265034 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-48f24c5a-135a-4675-b9e2-bf5d90f65529 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:16:11.277044 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-48f24c5a-135a-4675-b9e2-bf5d90f65529 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:16:11.283984 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-48f24c5a-135a-4675-b9e2-bf5d90f65529 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:11.284622 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-48f24c5a-135a-4675-b9e2-bf5d90f65529 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:11.286460 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-48f24c5a-135a-4675-b9e2-bf5d90f65529 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:11.287273 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-48f24c5a-135a-4675-b9e2-bf5d90f65529 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:11.389740 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-e5dd75cb-dd14-426d-9187-c7f7a49f32bd tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action" status: 200 len: 28070 microversion: 2.20 time: 0.154295 Dec 14 03:16:11.391137 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 112/225] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:16:11 2021] POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action => generated 28070 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:16:11.436657 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-48f24c5a-135a-4675-b9e2-bf5d90f65529 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action" status: 200 len: 27777 microversion: 2.1 time: 0.175431 Dec 14 03:16:11.437316 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 114/226] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:16:11 2021] POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action => generated 27777 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:16:11.464359 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-8a46bb0b-9a8a-4555-81d2-d9c0f50c9c2b tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:16:11.465064 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-8a46bb0b-9a8a-4555-81d2-d9c0f50c9c2b tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: de04da40-f5fd-43e2-b454-20a219642030] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:16:11.467821 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-ebd53540-cfbd-47e5-8b1c-5e314f14e7a5 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:16:11.468526 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-ebd53540-cfbd-47e5-8b1c-5e314f14e7a5 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: c6283570-4ee2-47bc-b58a-fbfe57acbcde] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:16:11.471925 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8a46bb0b-9a8a-4555-81d2-d9c0f50c9c2b tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:11.472375 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8a46bb0b-9a8a-4555-81d2-d9c0f50c9c2b tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:11.473162 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8a46bb0b-9a8a-4555-81d2-d9c0f50c9c2b tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:11.474104 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8a46bb0b-9a8a-4555-81d2-d9c0f50c9c2b tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:11.475798 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ebd53540-cfbd-47e5-8b1c-5e314f14e7a5 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:11.476254 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ebd53540-cfbd-47e5-8b1c-5e314f14e7a5 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:11.477030 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ebd53540-cfbd-47e5-8b1c-5e314f14e7a5 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:11.477471 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ebd53540-cfbd-47e5-8b1c-5e314f14e7a5 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:11.671031 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-ebd53540-cfbd-47e5-8b1c-5e314f14e7a5 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:16:11.684364 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-ebd53540-cfbd-47e5-8b1c-5e314f14e7a5 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde" status: 200 len: 1522 microversion: 2.1 time: 0.220444 Dec 14 03:16:11.684939 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 115/227] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:16:11 2021] GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde => generated 1522 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 03:16:11.689943 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-8a46bb0b-9a8a-4555-81d2-d9c0f50c9c2b tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:16:11.697489 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-8a46bb0b-9a8a-4555-81d2-d9c0f50c9c2b tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030" status: 200 len: 1317 microversion: 2.1 time: 0.237056 Dec 14 03:16:11.698038 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 113/228] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:16:11 2021] GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030 => generated 1317 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:16:12.401434 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-245b93c5-6a8b-41af-823d-cecdc97073b7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:16:12.402346 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-245b93c5-6a8b-41af-823d-cecdc97073b7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:16:12.408500 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-245b93c5-6a8b-41af-823d-cecdc97073b7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:12.408974 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-245b93c5-6a8b-41af-823d-cecdc97073b7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:12.409742 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-245b93c5-6a8b-41af-823d-cecdc97073b7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:12.410171 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-245b93c5-6a8b-41af-823d-cecdc97073b7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:12.448939 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-f7af822f-fa92-4d0c-a273-5572cd2ddb0e tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:16:12.449849 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-f7af822f-fa92-4d0c-a273-5572cd2ddb0e tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:16:12.456010 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f7af822f-fa92-4d0c-a273-5572cd2ddb0e tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:12.456449 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f7af822f-fa92-4d0c-a273-5572cd2ddb0e tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:12.457214 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f7af822f-fa92-4d0c-a273-5572cd2ddb0e tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:12.457640 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f7af822f-fa92-4d0c-a273-5572cd2ddb0e tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:17.553201 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-245b93c5-6a8b-41af-823d-cecdc97073b7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action" status: 200 len: 28187 microversion: 2.20 time: 5.155206 Dec 14 03:16:17.553846 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 116/229] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:16:12 2021] POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action => generated 28187 bytes in 5157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:16:17.558633 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-ed125781-eec3-4364-8644-c98733aa4082 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:16:17.559356 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-ed125781-eec3-4364-8644-c98733aa4082 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: c6283570-4ee2-47bc-b58a-fbfe57acbcde] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:16:17.566020 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ed125781-eec3-4364-8644-c98733aa4082 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:17.566466 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ed125781-eec3-4364-8644-c98733aa4082 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:17.567855 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ed125781-eec3-4364-8644-c98733aa4082 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:17.568287 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ed125781-eec3-4364-8644-c98733aa4082 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:17.578529 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-f7af822f-fa92-4d0c-a273-5572cd2ddb0e tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action" status: 200 len: 27811 microversion: 2.1 time: 5.132940 Dec 14 03:16:17.579537 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 114/230] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:16:12 2021] POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action => generated 27811 bytes in 5135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 14 03:16:17.584557 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-14f2554e-8980-48a1-8fd8-72630ab97f4a tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:16:17.585256 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-14f2554e-8980-48a1-8fd8-72630ab97f4a tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: de04da40-f5fd-43e2-b454-20a219642030] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:16:17.592859 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-14f2554e-8980-48a1-8fd8-72630ab97f4a tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:17.593515 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-14f2554e-8980-48a1-8fd8-72630ab97f4a tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:17.594316 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-14f2554e-8980-48a1-8fd8-72630ab97f4a tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:17.594748 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-14f2554e-8980-48a1-8fd8-72630ab97f4a tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:17.762863 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-ed125781-eec3-4364-8644-c98733aa4082 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:16:17.769928 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-14f2554e-8980-48a1-8fd8-72630ab97f4a tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:16:17.771172 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-ed125781-eec3-4364-8644-c98733aa4082 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde" status: 200 len: 1522 microversion: 2.1 time: 0.215430 Dec 14 03:16:17.771745 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 117/231] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:16:17 2021] GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde => generated 1522 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:16:17.777761 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-14f2554e-8980-48a1-8fd8-72630ab97f4a tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030" status: 200 len: 1317 microversion: 2.1 time: 0.197238 Dec 14 03:16:17.778307 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 115/232] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:16:17 2021] GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030 => generated 1317 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:16:18.565268 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-393061db-6a5d-4257-8475-d5296a62889a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:16:18.566205 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-393061db-6a5d-4257-8475-d5296a62889a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:16:18.573198 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-393061db-6a5d-4257-8475-d5296a62889a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:18.573654 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-393061db-6a5d-4257-8475-d5296a62889a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:18.574449 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-393061db-6a5d-4257-8475-d5296a62889a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:18.574890 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-393061db-6a5d-4257-8475-d5296a62889a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:18.590395 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-24fcefe8-1a83-4649-93f2-976fa6640a3b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:16:18.590952 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-24fcefe8-1a83-4649-93f2-976fa6640a3b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:16:18.597593 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-24fcefe8-1a83-4649-93f2-976fa6640a3b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:18.598061 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-24fcefe8-1a83-4649-93f2-976fa6640a3b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:18.598884 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-24fcefe8-1a83-4649-93f2-976fa6640a3b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:18.599298 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-24fcefe8-1a83-4649-93f2-976fa6640a3b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:18.887845 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-24fcefe8-1a83-4649-93f2-976fa6640a3b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action" status: 200 len: 27904 microversion: 2.1 time: 0.301407 Dec 14 03:16:18.891084 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 116/233] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:16:18 2021] POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action => generated 27904 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 14 03:16:18.893134 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-b68d1350-2fcf-4459-83e3-76aeb964eb8c tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:16:18.893824 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-b68d1350-2fcf-4459-83e3-76aeb964eb8c tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: c6283570-4ee2-47bc-b58a-fbfe57acbcde] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:16:18.900546 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b68d1350-2fcf-4459-83e3-76aeb964eb8c tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:18.900996 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b68d1350-2fcf-4459-83e3-76aeb964eb8c tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:18.901765 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b68d1350-2fcf-4459-83e3-76aeb964eb8c tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:18.902198 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b68d1350-2fcf-4459-83e3-76aeb964eb8c tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:18.940366 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-393061db-6a5d-4257-8475-d5296a62889a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action" status: 200 len: 28187 microversion: 2.20 time: 0.378644 Dec 14 03:16:18.944433 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 118/234] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:16:18 2021] POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action => generated 28187 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:16:18.945756 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-e38d9b51-89ac-4924-a827-21ccf58f6d86 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:16:18.946456 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-e38d9b51-89ac-4924-a827-21ccf58f6d86 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: de04da40-f5fd-43e2-b454-20a219642030] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:16:18.953201 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-e38d9b51-89ac-4924-a827-21ccf58f6d86 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:18.953639 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-e38d9b51-89ac-4924-a827-21ccf58f6d86 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:18.954421 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-e38d9b51-89ac-4924-a827-21ccf58f6d86 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:18.954860 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-e38d9b51-89ac-4924-a827-21ccf58f6d86 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:19.061199 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-b68d1350-2fcf-4459-83e3-76aeb964eb8c tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:16:19.068455 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-b68d1350-2fcf-4459-83e3-76aeb964eb8c tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde" status: 200 len: 1522 microversion: 2.1 time: 0.178964 Dec 14 03:16:19.069018 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 117/235] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:16:18 2021] GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:16:19.121098 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-e38d9b51-89ac-4924-a827-21ccf58f6d86 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:16:19.128406 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-e38d9b51-89ac-4924-a827-21ccf58f6d86 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030" status: 200 len: 1317 microversion: 2.1 time: 0.186310 Dec 14 03:16:19.128955 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 119/236] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:16:18 2021] GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030 => generated 1317 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:16:19.902455 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-c90ad3ff-7915-4e7d-8b0f-dcda34fb7a80 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:16:19.903729 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-c90ad3ff-7915-4e7d-8b0f-dcda34fb7a80 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:16:19.910814 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c90ad3ff-7915-4e7d-8b0f-dcda34fb7a80 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:19.911353 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c90ad3ff-7915-4e7d-8b0f-dcda34fb7a80 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:19.912149 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c90ad3ff-7915-4e7d-8b0f-dcda34fb7a80 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:19.912592 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c90ad3ff-7915-4e7d-8b0f-dcda34fb7a80 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:19.951373 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-3fbe3a1d-6bc8-4835-89ea-3e9ee3c03b3e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:16:19.952492 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-3fbe3a1d-6bc8-4835-89ea-3e9ee3c03b3e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:16:19.958833 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-3fbe3a1d-6bc8-4835-89ea-3e9ee3c03b3e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:19.959316 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-3fbe3a1d-6bc8-4835-89ea-3e9ee3c03b3e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:19.960091 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-3fbe3a1d-6bc8-4835-89ea-3e9ee3c03b3e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:19.960525 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-3fbe3a1d-6bc8-4835-89ea-3e9ee3c03b3e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:25.789815 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-c90ad3ff-7915-4e7d-8b0f-dcda34fb7a80 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action" status: 200 len: 28022 microversion: 2.1 time: 5.892524 Dec 14 03:16:25.793657 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 118/237] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:16:19 2021] POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action => generated 28022 bytes in 5895 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:16:25.795175 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-2ee690ec-e628-42ae-b108-b745a136a535 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:16:25.795863 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-2ee690ec-e628-42ae-b108-b745a136a535 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: c6283570-4ee2-47bc-b58a-fbfe57acbcde] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:16:25.803766 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2ee690ec-e628-42ae-b108-b745a136a535 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:25.804211 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2ee690ec-e628-42ae-b108-b745a136a535 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:25.804981 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2ee690ec-e628-42ae-b108-b745a136a535 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:25.805411 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2ee690ec-e628-42ae-b108-b745a136a535 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:25.933154 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-2ee690ec-e628-42ae-b108-b745a136a535 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:16:25.942642 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-2ee690ec-e628-42ae-b108-b745a136a535 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde" status: 200 len: 1522 microversion: 2.1 time: 0.150410 Dec 14 03:16:25.943231 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 119/238] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:16:25 2021] GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:16:25.947415 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-6a66a3e8-c251-48f3-9c19-21e120726470 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:16:25.948074 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-6a66a3e8-c251-48f3-9c19-21e120726470 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: de04da40-f5fd-43e2-b454-20a219642030] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:16:25.954339 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6a66a3e8-c251-48f3-9c19-21e120726470 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:25.955027 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6a66a3e8-c251-48f3-9c19-21e120726470 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:25.956225 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6a66a3e8-c251-48f3-9c19-21e120726470 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:25.956875 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6a66a3e8-c251-48f3-9c19-21e120726470 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:26.085325 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-6a66a3e8-c251-48f3-9c19-21e120726470 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:16:26.092465 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-6a66a3e8-c251-48f3-9c19-21e120726470 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030" status: 200 len: 1317 microversion: 2.1 time: 0.148308 Dec 14 03:16:26.093032 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 120/239] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:16:25 2021] GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030 => generated 1317 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:16:26.221199 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-3fbe3a1d-6bc8-4835-89ea-3e9ee3c03b3e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action" status: 200 len: 28187 microversion: 2.20 time: 6.273315 Dec 14 03:16:26.222029 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 120/240] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:16:19 2021] POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action => generated 28187 bytes in 6275 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 14 03:16:26.803899 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-e647d361-627f-45de-9b0e-b2f0d55a97bd tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:16:26.804846 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-e647d361-627f-45de-9b0e-b2f0d55a97bd tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:16:26.811027 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e647d361-627f-45de-9b0e-b2f0d55a97bd tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:26.811505 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e647d361-627f-45de-9b0e-b2f0d55a97bd tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:26.812278 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e647d361-627f-45de-9b0e-b2f0d55a97bd tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:26.812714 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e647d361-627f-45de-9b0e-b2f0d55a97bd tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:26.960648 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-1b86c855-9d0e-46de-8b7b-f8b6f8611117 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:16:26.961611 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-1b86c855-9d0e-46de-8b7b-f8b6f8611117 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: c6283570-4ee2-47bc-b58a-fbfe57acbcde] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:16:26.969207 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-1b86c855-9d0e-46de-8b7b-f8b6f8611117 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:26.969667 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-1b86c855-9d0e-46de-8b7b-f8b6f8611117 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:26.970462 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-1b86c855-9d0e-46de-8b7b-f8b6f8611117 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:26.970904 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-1b86c855-9d0e-46de-8b7b-f8b6f8611117 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:27.106173 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-1b86c855-9d0e-46de-8b7b-f8b6f8611117 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:16:27.113903 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-1b86c855-9d0e-46de-8b7b-f8b6f8611117 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde" status: 200 len: 1522 microversion: 2.1 time: 0.158069 Dec 14 03:16:27.114755 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 121/241] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:16:26 2021] GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 03:16:27.117303 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-e647d361-627f-45de-9b0e-b2f0d55a97bd tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action" status: 200 len: 28022 microversion: 2.1 time: 0.316801 Dec 14 03:16:27.117982 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 121/242] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:16:26 2021] POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action => generated 28022 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 14 03:16:27.119202 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-71b1f4ea-eee3-474e-8900-c9f956305dcd tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:16:27.120406 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-71b1f4ea-eee3-474e-8900-c9f956305dcd tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: de04da40-f5fd-43e2-b454-20a219642030] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:16:27.126622 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-71b1f4ea-eee3-474e-8900-c9f956305dcd tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:27.127300 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-71b1f4ea-eee3-474e-8900-c9f956305dcd tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:27.128239 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-71b1f4ea-eee3-474e-8900-c9f956305dcd tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:27.128682 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-71b1f4ea-eee3-474e-8900-c9f956305dcd tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:27.232728 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-0aee0ea5-7208-4559-9321-f95c16350abe tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:16:27.233748 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-0aee0ea5-7208-4559-9321-f95c16350abe tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:16:27.241506 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0aee0ea5-7208-4559-9321-f95c16350abe tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:27.242022 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0aee0ea5-7208-4559-9321-f95c16350abe tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:27.242862 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0aee0ea5-7208-4559-9321-f95c16350abe tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:27.243611 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0aee0ea5-7208-4559-9321-f95c16350abe tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:27.264154 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-71b1f4ea-eee3-474e-8900-c9f956305dcd tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:16:27.272879 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-71b1f4ea-eee3-474e-8900-c9f956305dcd tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030" status: 200 len: 1317 microversion: 2.1 time: 0.156902 Dec 14 03:16:27.273719 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 122/243] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:16:27 2021] GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:16:28.129200 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-99ef7988-4fb6-4418-91d6-d34ba4e80732 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:16:28.130113 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-99ef7988-4fb6-4418-91d6-d34ba4e80732 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:16:28.136279 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-99ef7988-4fb6-4418-91d6-d34ba4e80732 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:28.136725 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-99ef7988-4fb6-4418-91d6-d34ba4e80732 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:28.137500 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-99ef7988-4fb6-4418-91d6-d34ba4e80732 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:28.137931 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-99ef7988-4fb6-4418-91d6-d34ba4e80732 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:31.862753 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-0aee0ea5-7208-4559-9321-f95c16350abe tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action" status: 200 len: 28187 microversion: 2.20 time: 4.633728 Dec 14 03:16:31.864234 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 122/244] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:16:27 2021] POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action => generated 28187 bytes in 4636 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 14 03:16:31.868925 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-7335282c-18c1-4d06-9e24-701223e7e7ca tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:16:31.869616 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-7335282c-18c1-4d06-9e24-701223e7e7ca tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: c6283570-4ee2-47bc-b58a-fbfe57acbcde] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:16:31.876352 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7335282c-18c1-4d06-9e24-701223e7e7ca tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:31.876798 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7335282c-18c1-4d06-9e24-701223e7e7ca tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:31.877571 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7335282c-18c1-4d06-9e24-701223e7e7ca tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:31.878003 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7335282c-18c1-4d06-9e24-701223e7e7ca tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:31.900904 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-99ef7988-4fb6-4418-91d6-d34ba4e80732 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action" status: 200 len: 28139 microversion: 2.1 time: 3.775153 Dec 14 03:16:31.905104 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 123/245] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:16:28 2021] POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action => generated 28139 bytes in 3777 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 14 03:16:31.906540 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-db4a94f9-81ae-44cb-a0ff-8c93358671af tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:16:31.907275 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-db4a94f9-81ae-44cb-a0ff-8c93358671af tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: de04da40-f5fd-43e2-b454-20a219642030] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:16:31.914007 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-db4a94f9-81ae-44cb-a0ff-8c93358671af tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:31.914471 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-db4a94f9-81ae-44cb-a0ff-8c93358671af tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:31.915268 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-db4a94f9-81ae-44cb-a0ff-8c93358671af tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:31.915708 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-db4a94f9-81ae-44cb-a0ff-8c93358671af tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:32.065516 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-7335282c-18c1-4d06-9e24-701223e7e7ca tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:16:32.073406 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-7335282c-18c1-4d06-9e24-701223e7e7ca tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde" status: 200 len: 1522 microversion: 2.1 time: 0.208112 Dec 14 03:16:32.073972 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 123/246] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:16:31 2021] GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:16:32.078241 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [req-13728d8e-7e86-4a26-8e56-566f69f056f9 req-f3960dec-d73f-4030-bc15-035c618bd72a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de04da40-f5fd-43e2-b454-20a219642030", "name": "network-vif-plugged", "status": "completed", "tag": "b60f528b-8a43-4d0c-83ea-77e6e41b0fe5"}]} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:16:32.079768 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:16:32.079768 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: warnings.warn(msg) Dec 14 03:16:32.086100 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-13728d8e-7e86-4a26-8e56-566f69f056f9 req-f3960dec-d73f-4030-bc15-035c618bd72a service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:32.086544 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-13728d8e-7e86-4a26-8e56-566f69f056f9 req-f3960dec-d73f-4030-bc15-035c618bd72a service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:32.096992 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.compute.server_external_events [req-13728d8e-7e86-4a26-8e56-566f69f056f9 req-f3960dec-d73f-4030-bc15-035c618bd72a service nova] Creating event network-vif-plugged:b60f528b-8a43-4d0c-83ea-77e6e41b0fe5 for instance de04da40-f5fd-43e2-b454-20a219642030 on hv-cinder-81803 Dec 14 03:16:32.100172 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-db4a94f9-81ae-44cb-a0ff-8c93358671af tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:16:32.101848 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [req-13728d8e-7e86-4a26-8e56-566f69f056f9 req-f3960dec-d73f-4030-bc15-035c618bd72a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.026745 Dec 14 03:16:32.102432 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 124/247] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Dec 14 03:16:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:16:32.107462 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-db4a94f9-81ae-44cb-a0ff-8c93358671af tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030" status: 200 len: 1317 microversion: 2.1 time: 0.204532 Dec 14 03:16:32.108015 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 124/248] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:16:31 2021] GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030 => generated 1317 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:16:32.875455 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-8453b512-4b6a-4636-a70e-f5a430348c2f tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:16:32.876571 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-8453b512-4b6a-4636-a70e-f5a430348c2f tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:16:32.883334 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8453b512-4b6a-4636-a70e-f5a430348c2f tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:32.883787 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8453b512-4b6a-4636-a70e-f5a430348c2f tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:32.884572 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8453b512-4b6a-4636-a70e-f5a430348c2f tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:32.885008 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8453b512-4b6a-4636-a70e-f5a430348c2f tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:32.913148 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-e67452ec-7376-41f7-8b02-a62e2a7d31a7 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:16:32.914042 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-e67452ec-7376-41f7-8b02-a62e2a7d31a7 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:16:32.920220 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-e67452ec-7376-41f7-8b02-a62e2a7d31a7 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:32.920664 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-e67452ec-7376-41f7-8b02-a62e2a7d31a7 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:32.921427 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-e67452ec-7376-41f7-8b02-a62e2a7d31a7 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:32.921860 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-e67452ec-7376-41f7-8b02-a62e2a7d31a7 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:33.615391 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-e67452ec-7376-41f7-8b02-a62e2a7d31a7 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action" status: 200 len: 28139 microversion: 2.1 time: 0.706215 Dec 14 03:16:33.616030 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 125/249] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:16:32 2021] POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action => generated 28139 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 14 03:16:33.620717 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-7544f536-c998-4a64-b099-6d1b5f4a6228 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:16:33.621414 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-7544f536-c998-4a64-b099-6d1b5f4a6228 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: c6283570-4ee2-47bc-b58a-fbfe57acbcde] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:16:33.628120 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-7544f536-c998-4a64-b099-6d1b5f4a6228 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:33.628576 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-7544f536-c998-4a64-b099-6d1b5f4a6228 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:33.629354 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-7544f536-c998-4a64-b099-6d1b5f4a6228 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:33.629793 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-7544f536-c998-4a64-b099-6d1b5f4a6228 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:33.716902 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-8453b512-4b6a-4636-a70e-f5a430348c2f tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action" status: 200 len: 28187 microversion: 2.20 time: 0.845731 Dec 14 03:16:33.717541 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 125/250] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:16:32 2021] POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action => generated 28187 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:16:33.723894 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-446a3c27-a70e-402c-9aaf-c7d5c14dcbe6 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:16:33.724603 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-446a3c27-a70e-402c-9aaf-c7d5c14dcbe6 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: de04da40-f5fd-43e2-b454-20a219642030] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:16:33.731572 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-446a3c27-a70e-402c-9aaf-c7d5c14dcbe6 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:33.731989 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-446a3c27-a70e-402c-9aaf-c7d5c14dcbe6 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:33.732656 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-446a3c27-a70e-402c-9aaf-c7d5c14dcbe6 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:33.733095 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-446a3c27-a70e-402c-9aaf-c7d5c14dcbe6 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:33.764326 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-7544f536-c998-4a64-b099-6d1b5f4a6228 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:16:33.773355 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-7544f536-c998-4a64-b099-6d1b5f4a6228 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde" status: 200 len: 1522 microversion: 2.1 time: 0.156208 Dec 14 03:16:33.774065 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 126/251] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:16:33 2021] GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:16:33.891620 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-446a3c27-a70e-402c-9aaf-c7d5c14dcbe6 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:16:33.900288 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-446a3c27-a70e-402c-9aaf-c7d5c14dcbe6 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030" status: 200 len: 1317 microversion: 2.1 time: 0.181419 Dec 14 03:16:33.901010 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 126/252] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:16:33 2021] GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030 => generated 1317 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:16:34.626120 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-5819eade-c8c3-4ab5-8ac3-335e32b7b633 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:16:34.627107 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-5819eade-c8c3-4ab5-8ac3-335e32b7b633 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:16:34.634546 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-5819eade-c8c3-4ab5-8ac3-335e32b7b633 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:34.634999 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-5819eade-c8c3-4ab5-8ac3-335e32b7b633 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:34.635808 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-5819eade-c8c3-4ab5-8ac3-335e32b7b633 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:34.636246 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-5819eade-c8c3-4ab5-8ac3-335e32b7b633 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:34.727366 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-5819eade-c8c3-4ab5-8ac3-335e32b7b633 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action" status: 200 len: 28139 microversion: 2.1 time: 0.104703 Dec 14 03:16:34.728211 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 127/253] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:16:34 2021] POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action => generated 28139 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:16:34.728866 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-9f9167b5-42e9-420d-a0c6-8655760ac0b9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:16:34.729851 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-9f9167b5-42e9-420d-a0c6-8655760ac0b9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:16:34.736180 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9f9167b5-42e9-420d-a0c6-8655760ac0b9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:34.736624 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9f9167b5-42e9-420d-a0c6-8655760ac0b9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:34.737406 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9f9167b5-42e9-420d-a0c6-8655760ac0b9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:34.737839 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9f9167b5-42e9-420d-a0c6-8655760ac0b9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:34.789853 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-8b49a622-4183-4d91-b14e-03ae53947d42 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:16:34.790542 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-8b49a622-4183-4d91-b14e-03ae53947d42 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: c6283570-4ee2-47bc-b58a-fbfe57acbcde] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:16:34.797332 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-8b49a622-4183-4d91-b14e-03ae53947d42 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:34.797779 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-8b49a622-4183-4d91-b14e-03ae53947d42 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:34.798557 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-8b49a622-4183-4d91-b14e-03ae53947d42 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:34.798992 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-8b49a622-4183-4d91-b14e-03ae53947d42 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:34.859851 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-9f9167b5-42e9-420d-a0c6-8655760ac0b9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action" status: 200 len: 28187 microversion: 2.20 time: 0.134536 Dec 14 03:16:34.861074 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 127/254] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:16:34 2021] POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action => generated 28187 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 14 03:16:34.917444 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-b8b855a2-abcd-40de-8fb8-783d632686eb tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:16:34.918200 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-b8b855a2-abcd-40de-8fb8-783d632686eb tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: de04da40-f5fd-43e2-b454-20a219642030] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:16:34.925314 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b8b855a2-abcd-40de-8fb8-783d632686eb tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:34.926316 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b8b855a2-abcd-40de-8fb8-783d632686eb tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:34.927161 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b8b855a2-abcd-40de-8fb8-783d632686eb tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:34.927591 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b8b855a2-abcd-40de-8fb8-783d632686eb tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:34.943974 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-8b49a622-4183-4d91-b14e-03ae53947d42 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:16:34.951923 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-8b49a622-4183-4d91-b14e-03ae53947d42 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde" status: 200 len: 1502 microversion: 2.1 time: 0.166055 Dec 14 03:16:34.952578 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 128/255] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:16:34 2021] GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde => generated 1502 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 03:16:34.968566 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-aed201e8-7c8e-4e2f-8c59-450cf39fb122 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:16:34.969366 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-aed201e8-7c8e-4e2f-8c59-450cf39fb122 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: 4687b559-c95a-4b82-a076-a7468c10ebef] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:16:34.975623 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-aed201e8-7c8e-4e2f-8c59-450cf39fb122 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:34.976414 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-aed201e8-7c8e-4e2f-8c59-450cf39fb122 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:34.977399 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-aed201e8-7c8e-4e2f-8c59-450cf39fb122 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:34.978032 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-aed201e8-7c8e-4e2f-8c59-450cf39fb122 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:35.096482 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-b8b855a2-abcd-40de-8fb8-783d632686eb tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:16:35.115581 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-b8b855a2-abcd-40de-8fb8-783d632686eb tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030" status: 200 len: 1317 microversion: 2.1 time: 0.201881 Dec 14 03:16:35.116155 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 128/256] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:16:34 2021] GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030 => generated 1317 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 03:16:35.164326 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-aed201e8-7c8e-4e2f-8c59-450cf39fb122 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:16:35.192010 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-aed201e8-7c8e-4e2f-8c59-450cf39fb122 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef" status: 200 len: 1515 microversion: 2.1 time: 0.226831 Dec 14 03:16:35.192887 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 129/257] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:16:34 2021] GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef => generated 1515 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 03:16:35.739703 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-0d0f0a27-dd25-478f-bac2-ddfcd6226a71 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:16:35.740619 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-0d0f0a27-dd25-478f-bac2-ddfcd6226a71 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:16:35.746875 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0d0f0a27-dd25-478f-bac2-ddfcd6226a71 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:35.747361 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0d0f0a27-dd25-478f-bac2-ddfcd6226a71 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:35.748130 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0d0f0a27-dd25-478f-bac2-ddfcd6226a71 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:35.748560 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0d0f0a27-dd25-478f-bac2-ddfcd6226a71 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:35.872912 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-ed2a7f76-feb8-48f8-88ae-1468ea5fb238 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:16:35.873868 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-ed2a7f76-feb8-48f8-88ae-1468ea5fb238 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:16:35.880563 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ed2a7f76-feb8-48f8-88ae-1468ea5fb238 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:35.881020 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ed2a7f76-feb8-48f8-88ae-1468ea5fb238 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:35.881871 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ed2a7f76-feb8-48f8-88ae-1468ea5fb238 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:35.882321 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ed2a7f76-feb8-48f8-88ae-1468ea5fb238 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:35.911180 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-0d0f0a27-dd25-478f-bac2-ddfcd6226a71 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action" status: 200 len: 28139 microversion: 2.1 time: 0.174849 Dec 14 03:16:35.911830 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 129/258] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:16:35 2021] POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action => generated 28139 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:16:36.065710 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-ed2a7f76-feb8-48f8-88ae-1468ea5fb238 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action" status: 200 len: 28187 microversion: 2.20 time: 0.196589 Dec 14 03:16:36.067151 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 130/259] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:16:35 2021] POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action => generated 28187 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 14 03:16:36.133804 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-ed979463-4f40-403a-abb1-44906725be8f tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:16:36.134750 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-ed979463-4f40-403a-abb1-44906725be8f tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: de04da40-f5fd-43e2-b454-20a219642030] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:16:36.141940 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ed979463-4f40-403a-abb1-44906725be8f tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:36.142382 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ed979463-4f40-403a-abb1-44906725be8f tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:36.143175 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ed979463-4f40-403a-abb1-44906725be8f tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:36.143602 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ed979463-4f40-403a-abb1-44906725be8f tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:36.298685 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-ed979463-4f40-403a-abb1-44906725be8f tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:16:36.310007 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-ed979463-4f40-403a-abb1-44906725be8f tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030" status: 200 len: 1507 microversion: 2.1 time: 0.180941 Dec 14 03:16:36.310626 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 130/260] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:16:36 2021] GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030 => generated 1507 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:16:36.923204 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-ab27a971-f724-4ad2-9a69-e12d56ca07f8 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:16:36.924206 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-ab27a971-f724-4ad2-9a69-e12d56ca07f8 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:16:36.931412 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ab27a971-f724-4ad2-9a69-e12d56ca07f8 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:36.932123 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ab27a971-f724-4ad2-9a69-e12d56ca07f8 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:36.933093 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ab27a971-f724-4ad2-9a69-e12d56ca07f8 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:36.933710 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ab27a971-f724-4ad2-9a69-e12d56ca07f8 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:37.046826 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-ab27a971-f724-4ad2-9a69-e12d56ca07f8 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action" status: 200 len: 28139 microversion: 2.1 time: 0.127165 Dec 14 03:16:37.047866 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 131/261] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:16:36 2021] POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action => generated 28139 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:16:37.078845 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-9b630ffd-5cec-45fe-ae1a-9db6e2877555 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:16:37.079825 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-9b630ffd-5cec-45fe-ae1a-9db6e2877555 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:16:37.086675 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9b630ffd-5cec-45fe-ae1a-9db6e2877555 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:37.087216 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9b630ffd-5cec-45fe-ae1a-9db6e2877555 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:37.087987 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9b630ffd-5cec-45fe-ae1a-9db6e2877555 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:37.088415 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9b630ffd-5cec-45fe-ae1a-9db6e2877555 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:37.179871 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-9b630ffd-5cec-45fe-ae1a-9db6e2877555 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action" status: 200 len: 28187 microversion: 2.20 time: 0.104448 Dec 14 03:16:37.180511 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 131/262] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:16:37 2021] POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action => generated 28187 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:16:37.573011 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-854c2573-dc30-4a9e-a455-2d47f1dd6a41 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:16:37.574073 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-854c2573-dc30-4a9e-a455-2d47f1dd6a41 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: 4687b559-c95a-4b82-a076-a7468c10ebef] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:16:37.580912 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-854c2573-dc30-4a9e-a455-2d47f1dd6a41 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:37.581308 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-854c2573-dc30-4a9e-a455-2d47f1dd6a41 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:37.582840 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-854c2573-dc30-4a9e-a455-2d47f1dd6a41 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:37.583310 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-854c2573-dc30-4a9e-a455-2d47f1dd6a41 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:37.606772 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.objects.instance [None req-854c2573-dc30-4a9e-a455-2d47f1dd6a41 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lazy-loading 'flavor' on Instance uuid 4687b559-c95a-4b82-a076-a7468c10ebef {{(pid=116071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 14 03:16:37.694677 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-854c2573-dc30-4a9e-a455-2d47f1dd6a41 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "POST /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef/action" status: 200 len: 32 microversion: 2.1 time: 0.125771 Dec 14 03:16:37.695303 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 132/263] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:16:37 2021] POST /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef/action => generated 32 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 14 03:16:37.704848 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-a30e4add-bc5f-4b80-82ce-2ab9a5588c89 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:16:37.705544 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-a30e4add-bc5f-4b80-82ce-2ab9a5588c89 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: 4687b559-c95a-4b82-a076-a7468c10ebef] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:16:37.712757 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a30e4add-bc5f-4b80-82ce-2ab9a5588c89 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:37.713233 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a30e4add-bc5f-4b80-82ce-2ab9a5588c89 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:37.714242 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a30e4add-bc5f-4b80-82ce-2ab9a5588c89 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:37.714685 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a30e4add-bc5f-4b80-82ce-2ab9a5588c89 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:37.857279 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-a30e4add-bc5f-4b80-82ce-2ab9a5588c89 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:16:37.865449 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-a30e4add-bc5f-4b80-82ce-2ab9a5588c89 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef" status: 200 len: 1521 microversion: 2.1 time: 0.164605 Dec 14 03:16:37.866119 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 132/264] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:16:37 2021] GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:16:38.059404 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-6f2db36c-3ab5-4484-9160-596a7638f40a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:16:38.060423 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-6f2db36c-3ab5-4484-9160-596a7638f40a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:16:38.069079 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-6f2db36c-3ab5-4484-9160-596a7638f40a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:38.069538 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-6f2db36c-3ab5-4484-9160-596a7638f40a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:38.070333 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-6f2db36c-3ab5-4484-9160-596a7638f40a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:38.070775 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-6f2db36c-3ab5-4484-9160-596a7638f40a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:38.178107 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-6f2db36c-3ab5-4484-9160-596a7638f40a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action" status: 200 len: 28139 microversion: 2.1 time: 0.122675 Dec 14 03:16:38.181407 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 133/265] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:16:38 2021] POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action => generated 28139 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:16:38.191524 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-51ee5a54-7514-434c-9dea-8aeece72e69a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:16:38.192438 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-51ee5a54-7514-434c-9dea-8aeece72e69a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:16:38.198549 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-51ee5a54-7514-434c-9dea-8aeece72e69a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:38.198993 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-51ee5a54-7514-434c-9dea-8aeece72e69a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:38.199795 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-51ee5a54-7514-434c-9dea-8aeece72e69a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:38.200222 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-51ee5a54-7514-434c-9dea-8aeece72e69a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:38.388810 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-51ee5a54-7514-434c-9dea-8aeece72e69a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action" status: 200 len: 28187 microversion: 2.20 time: 0.200702 Dec 14 03:16:38.389473 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 133/266] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:16:38 2021] POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action => generated 28187 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:16:38.724490 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-b5a2e048-ffed-49d4-94aa-d4ea4e3c5af1 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e9e1a43c-93ea-4395-8c70-fee9478dbb21"}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:16:38.725627 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-b5a2e048-ffed-49d4-94aa-d4ea4e3c5af1 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: de04da40-f5fd-43e2-b454-20a219642030] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:16:38.732285 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b5a2e048-ffed-49d4-94aa-d4ea4e3c5af1 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:38.732732 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b5a2e048-ffed-49d4-94aa-d4ea4e3c5af1 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:38.733502 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b5a2e048-ffed-49d4-94aa-d4ea4e3c5af1 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:38.733935 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b5a2e048-ffed-49d4-94aa-d4ea4e3c5af1 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:38.883762 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-c8c7eeec-2e33-4b60-84ed-60d13c8f86ee tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:16:38.884691 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-c8c7eeec-2e33-4b60-84ed-60d13c8f86ee tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: 4687b559-c95a-4b82-a076-a7468c10ebef] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:16:38.891944 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c8c7eeec-2e33-4b60-84ed-60d13c8f86ee tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:38.892401 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c8c7eeec-2e33-4b60-84ed-60d13c8f86ee tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:38.893194 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c8c7eeec-2e33-4b60-84ed-60d13c8f86ee tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:38.893815 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c8c7eeec-2e33-4b60-84ed-60d13c8f86ee tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:39.041372 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-b5a2e048-ffed-49d4-94aa-d4ea4e3c5af1 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "POST /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.320226 Dec 14 03:16:39.046513 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 134/267] 10.222.0.43 () {60 vars in 1322 bytes} [Tue Dec 14 03:16:38 2021] POST /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030/os-volume_attachments => generated 194 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:16:39.046666 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-c8c7eeec-2e33-4b60-84ed-60d13c8f86ee tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:16:39.052193 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-c8c7eeec-2e33-4b60-84ed-60d13c8f86ee tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef" status: 200 len: 1521 microversion: 2.1 time: 0.172442 Dec 14 03:16:39.052850 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 134/268] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:16:38 2021] GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 03:16:39.191960 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-93cc0e24-af05-4397-ac73-796d1fe02584 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:16:39.193191 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-93cc0e24-af05-4397-ac73-796d1fe02584 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:16:39.199562 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-93cc0e24-af05-4397-ac73-796d1fe02584 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:39.200013 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-93cc0e24-af05-4397-ac73-796d1fe02584 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:39.200792 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-93cc0e24-af05-4397-ac73-796d1fe02584 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:39.201230 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-93cc0e24-af05-4397-ac73-796d1fe02584 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:39.400458 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-d9a8628d-859b-4784-9944-d47db73bce80 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:16:39.401306 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-d9a8628d-859b-4784-9944-d47db73bce80 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:16:39.407749 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d9a8628d-859b-4784-9944-d47db73bce80 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:39.408204 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d9a8628d-859b-4784-9944-d47db73bce80 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:39.408990 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d9a8628d-859b-4784-9944-d47db73bce80 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:39.409430 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d9a8628d-859b-4784-9944-d47db73bce80 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:39.470248 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-93cc0e24-af05-4397-ac73-796d1fe02584 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action" status: 200 len: 28139 microversion: 2.1 time: 0.283342 Dec 14 03:16:39.474223 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 135/269] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:16:39 2021] POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action => generated 28139 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:16:39.586200 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-d9a8628d-859b-4784-9944-d47db73bce80 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action" status: 200 len: 28187 microversion: 2.20 time: 0.189311 Dec 14 03:16:39.586887 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 135/270] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:16:39 2021] POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action => generated 28187 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 14 03:16:40.072556 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-d9ffdb0f-55ff-43d9-bb14-d1877342fab7 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:16:40.073407 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-d9ffdb0f-55ff-43d9-bb14-d1877342fab7 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: 4687b559-c95a-4b82-a076-a7468c10ebef] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:16:40.080392 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-d9ffdb0f-55ff-43d9-bb14-d1877342fab7 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:40.080959 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-d9ffdb0f-55ff-43d9-bb14-d1877342fab7 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:40.082605 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-d9ffdb0f-55ff-43d9-bb14-d1877342fab7 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:40.083096 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-d9ffdb0f-55ff-43d9-bb14-d1877342fab7 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:40.237201 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-d9ffdb0f-55ff-43d9-bb14-d1877342fab7 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:16:40.244847 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-d9ffdb0f-55ff-43d9-bb14-d1877342fab7 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef" status: 200 len: 1521 microversion: 2.1 time: 0.176694 Dec 14 03:16:40.245410 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 136/271] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:16:40 2021] GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:16:40.481965 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-04f1ff88-0b99-46b6-badf-e77a65537cc8 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:16:40.483087 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-04f1ff88-0b99-46b6-badf-e77a65537cc8 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:16:40.490289 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-04f1ff88-0b99-46b6-badf-e77a65537cc8 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:40.490817 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-04f1ff88-0b99-46b6-badf-e77a65537cc8 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:40.491697 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-04f1ff88-0b99-46b6-badf-e77a65537cc8 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:40.492201 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-04f1ff88-0b99-46b6-badf-e77a65537cc8 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:40.598243 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-f188e6b4-150c-4cf0-8b5a-ba43d41c8d25 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:16:40.599433 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-f188e6b4-150c-4cf0-8b5a-ba43d41c8d25 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:16:40.602353 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-04f1ff88-0b99-46b6-badf-e77a65537cc8 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action" status: 200 len: 28139 microversion: 2.1 time: 0.124035 Dec 14 03:16:40.607611 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 136/272] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:16:40 2021] POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action => generated 28139 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:16:40.607770 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-f188e6b4-150c-4cf0-8b5a-ba43d41c8d25 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:40.607770 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-f188e6b4-150c-4cf0-8b5a-ba43d41c8d25 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:40.608280 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-f188e6b4-150c-4cf0-8b5a-ba43d41c8d25 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:40.608798 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-f188e6b4-150c-4cf0-8b5a-ba43d41c8d25 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:40.727938 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-f188e6b4-150c-4cf0-8b5a-ba43d41c8d25 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action" status: 200 len: 28187 microversion: 2.20 time: 0.133721 Dec 14 03:16:40.731926 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 137/273] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:16:40 2021] POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action => generated 28187 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 14 03:16:41.262371 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-5c6f68bc-9974-4e61-8208-d2de29f36cbe tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:16:41.263353 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-5c6f68bc-9974-4e61-8208-d2de29f36cbe tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: 4687b559-c95a-4b82-a076-a7468c10ebef] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:16:41.270334 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5c6f68bc-9974-4e61-8208-d2de29f36cbe tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:41.271207 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5c6f68bc-9974-4e61-8208-d2de29f36cbe tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:41.272339 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5c6f68bc-9974-4e61-8208-d2de29f36cbe tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:41.272841 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5c6f68bc-9974-4e61-8208-d2de29f36cbe tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:41.487256 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-5c6f68bc-9974-4e61-8208-d2de29f36cbe tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:16:41.501999 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-5c6f68bc-9974-4e61-8208-d2de29f36cbe tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef" status: 200 len: 1521 microversion: 2.1 time: 0.243371 Dec 14 03:16:41.502994 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 137/274] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:16:41 2021] GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef => generated 1521 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:16:41.619414 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-f1c99445-21f8-4aaa-a0ea-eac001b878ed tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:16:41.623157 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-f1c99445-21f8-4aaa-a0ea-eac001b878ed tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:16:41.633424 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-f1c99445-21f8-4aaa-a0ea-eac001b878ed tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:41.634094 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-f1c99445-21f8-4aaa-a0ea-eac001b878ed tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:41.635138 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-f1c99445-21f8-4aaa-a0ea-eac001b878ed tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:41.635723 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-f1c99445-21f8-4aaa-a0ea-eac001b878ed tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:41.742113 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-646556e5-c028-4cf4-b3eb-a7d8fd242331 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:16:41.743887 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-646556e5-c028-4cf4-b3eb-a7d8fd242331 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:16:41.751176 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-646556e5-c028-4cf4-b3eb-a7d8fd242331 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:41.752167 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-646556e5-c028-4cf4-b3eb-a7d8fd242331 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:41.753223 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-646556e5-c028-4cf4-b3eb-a7d8fd242331 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:41.754159 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-646556e5-c028-4cf4-b3eb-a7d8fd242331 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:41.761503 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-f1c99445-21f8-4aaa-a0ea-eac001b878ed tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action" status: 200 len: 28139 microversion: 2.1 time: 0.148571 Dec 14 03:16:41.762531 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 138/275] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:16:41 2021] POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action => generated 28139 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:16:41.860803 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-646556e5-c028-4cf4-b3eb-a7d8fd242331 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action" status: 200 len: 28187 microversion: 2.20 time: 0.124191 Dec 14 03:16:41.863525 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 138/276] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:16:41 2021] POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action => generated 28187 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 14 03:16:42.519787 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-479bc359-e78b-429a-a587-0200f5e46c96 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:16:42.520909 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-479bc359-e78b-429a-a587-0200f5e46c96 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: 4687b559-c95a-4b82-a076-a7468c10ebef] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:16:42.528858 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-479bc359-e78b-429a-a587-0200f5e46c96 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:42.529393 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-479bc359-e78b-429a-a587-0200f5e46c96 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:42.530239 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-479bc359-e78b-429a-a587-0200f5e46c96 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:42.530694 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-479bc359-e78b-429a-a587-0200f5e46c96 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:42.716937 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-479bc359-e78b-429a-a587-0200f5e46c96 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:16:42.728024 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-479bc359-e78b-429a-a587-0200f5e46c96 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef" status: 200 len: 1521 microversion: 2.1 time: 0.212353 Dec 14 03:16:42.728602 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 139/277] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:16:42 2021] GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:16:42.774995 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-f3361ef1-c5f1-4c79-9861-25ffe59c5360 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:16:42.776274 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-f3361ef1-c5f1-4c79-9861-25ffe59c5360 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:16:42.792878 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f3361ef1-c5f1-4c79-9861-25ffe59c5360 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:42.794812 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f3361ef1-c5f1-4c79-9861-25ffe59c5360 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:42.795709 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f3361ef1-c5f1-4c79-9861-25ffe59c5360 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:42.798093 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f3361ef1-c5f1-4c79-9861-25ffe59c5360 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:42.888556 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-e37c07d8-3611-48bc-8d51-83e236599c8c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:16:42.890889 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-e37c07d8-3611-48bc-8d51-83e236599c8c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:16:42.906287 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-e37c07d8-3611-48bc-8d51-83e236599c8c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:42.906740 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-e37c07d8-3611-48bc-8d51-83e236599c8c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:42.909701 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-e37c07d8-3611-48bc-8d51-83e236599c8c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:42.910803 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-e37c07d8-3611-48bc-8d51-83e236599c8c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:42.937306 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-f3361ef1-c5f1-4c79-9861-25ffe59c5360 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action" status: 200 len: 28139 microversion: 2.1 time: 0.166316 Dec 14 03:16:42.937786 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 139/278] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:16:42 2021] POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action => generated 28139 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:16:43.022497 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-e37c07d8-3611-48bc-8d51-83e236599c8c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action" status: 200 len: 28187 microversion: 2.20 time: 0.147298 Dec 14 03:16:43.023456 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 140/279] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:16:42 2021] POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action => generated 28187 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 14 03:16:43.745867 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-eb7d8821-5402-4b88-8521-ffe3a01c8f93 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:16:43.746666 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-eb7d8821-5402-4b88-8521-ffe3a01c8f93 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: 4687b559-c95a-4b82-a076-a7468c10ebef] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:16:43.753834 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-eb7d8821-5402-4b88-8521-ffe3a01c8f93 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:43.754822 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-eb7d8821-5402-4b88-8521-ffe3a01c8f93 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:43.755797 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-eb7d8821-5402-4b88-8521-ffe3a01c8f93 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:43.756388 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-eb7d8821-5402-4b88-8521-ffe3a01c8f93 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:43.950478 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-cfa1a6e0-4ee1-4dc7-8a7f-36f0b7f905b1 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:16:43.952517 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-cfa1a6e0-4ee1-4dc7-8a7f-36f0b7f905b1 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:16:43.961586 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-cfa1a6e0-4ee1-4dc7-8a7f-36f0b7f905b1 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:43.962252 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-cfa1a6e0-4ee1-4dc7-8a7f-36f0b7f905b1 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:43.963381 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-cfa1a6e0-4ee1-4dc7-8a7f-36f0b7f905b1 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:43.964043 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-cfa1a6e0-4ee1-4dc7-8a7f-36f0b7f905b1 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:44.010237 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-eb7d8821-5402-4b88-8521-ffe3a01c8f93 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:16:44.017650 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-eb7d8821-5402-4b88-8521-ffe3a01c8f93 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef" status: 200 len: 1521 microversion: 2.1 time: 0.276280 Dec 14 03:16:44.018365 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 140/280] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:16:43 2021] GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef => generated 1521 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:16:44.033608 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-bf1f0ea3-a53e-471d-8609-6ce6e2a78ede tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:16:44.034640 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-bf1f0ea3-a53e-471d-8609-6ce6e2a78ede tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:16:44.040983 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-bf1f0ea3-a53e-471d-8609-6ce6e2a78ede tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:44.041435 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-bf1f0ea3-a53e-471d-8609-6ce6e2a78ede tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:44.042221 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-bf1f0ea3-a53e-471d-8609-6ce6e2a78ede tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:44.042658 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-bf1f0ea3-a53e-471d-8609-6ce6e2a78ede tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:44.077956 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-cfa1a6e0-4ee1-4dc7-8a7f-36f0b7f905b1 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action" status: 200 len: 28139 microversion: 2.1 time: 0.131943 Dec 14 03:16:44.082934 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 141/281] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:16:43 2021] POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action => generated 28139 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:16:44.139901 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-bf1f0ea3-a53e-471d-8609-6ce6e2a78ede tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action" status: 200 len: 28187 microversion: 2.20 time: 0.109819 Dec 14 03:16:44.140552 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 141/282] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:16:44 2021] POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action => generated 28187 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 14 03:16:45.038585 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-6cc5f5ca-53d3-44b2-933a-6768091a24d5 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:16:45.039926 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-6cc5f5ca-53d3-44b2-933a-6768091a24d5 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: 4687b559-c95a-4b82-a076-a7468c10ebef] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:16:45.047798 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-6cc5f5ca-53d3-44b2-933a-6768091a24d5 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:45.048430 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-6cc5f5ca-53d3-44b2-933a-6768091a24d5 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:45.049460 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-6cc5f5ca-53d3-44b2-933a-6768091a24d5 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:45.050053 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-6cc5f5ca-53d3-44b2-933a-6768091a24d5 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:45.090538 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-cdf28689-ce73-4bb4-8fe7-89d5530875df tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:16:45.092364 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-cdf28689-ce73-4bb4-8fe7-89d5530875df tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:16:45.100519 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-cdf28689-ce73-4bb4-8fe7-89d5530875df tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:45.101833 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-cdf28689-ce73-4bb4-8fe7-89d5530875df tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:45.102799 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-cdf28689-ce73-4bb4-8fe7-89d5530875df tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:45.103415 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-cdf28689-ce73-4bb4-8fe7-89d5530875df tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:45.206453 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-cdf28689-ce73-4bb4-8fe7-89d5530875df tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action" status: 200 len: 28139 microversion: 2.1 time: 0.119406 Dec 14 03:16:45.207668 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 142/283] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:16:45 2021] POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action => generated 28139 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:16:45.217018 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-5a017fce-1f4c-4f30-8de5-181e77547faf tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:16:45.218217 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-5a017fce-1f4c-4f30-8de5-181e77547faf tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:16:45.227273 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5a017fce-1f4c-4f30-8de5-181e77547faf tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:45.227986 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5a017fce-1f4c-4f30-8de5-181e77547faf tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:45.228941 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5a017fce-1f4c-4f30-8de5-181e77547faf tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:45.229677 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5a017fce-1f4c-4f30-8de5-181e77547faf tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:45.301634 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-6cc5f5ca-53d3-44b2-933a-6768091a24d5 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:16:45.314542 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-6cc5f5ca-53d3-44b2-933a-6768091a24d5 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef" status: 200 len: 1521 microversion: 2.1 time: 0.279954 Dec 14 03:16:45.315182 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 142/284] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:16:45 2021] GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef => generated 1521 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:16:45.343204 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-5a017fce-1f4c-4f30-8de5-181e77547faf tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action" status: 200 len: 28187 microversion: 2.20 time: 0.133693 Dec 14 03:16:45.344175 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 143/285] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:16:45 2021] POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action => generated 28187 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:16:46.222940 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-c8d19e30-9403-4034-8e37-7f397211333c tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:16:46.225689 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-c8d19e30-9403-4034-8e37-7f397211333c tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:16:46.239611 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c8d19e30-9403-4034-8e37-7f397211333c tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:46.240066 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c8d19e30-9403-4034-8e37-7f397211333c tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:46.246863 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c8d19e30-9403-4034-8e37-7f397211333c tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:46.246863 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c8d19e30-9403-4034-8e37-7f397211333c tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:46.333039 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-5bdcf263-b892-4275-a434-30786a67f16d tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:16:46.333850 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-5bdcf263-b892-4275-a434-30786a67f16d tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: 4687b559-c95a-4b82-a076-a7468c10ebef] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:16:46.341836 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5bdcf263-b892-4275-a434-30786a67f16d tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:46.342586 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5bdcf263-b892-4275-a434-30786a67f16d tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:46.343524 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5bdcf263-b892-4275-a434-30786a67f16d tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:46.344182 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5bdcf263-b892-4275-a434-30786a67f16d tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:46.368278 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-c8d19e30-9403-4034-8e37-7f397211333c tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action" status: 200 len: 28139 microversion: 2.1 time: 0.147074 Dec 14 03:16:46.369746 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 143/286] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:16:46 2021] POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action => generated 28139 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:16:46.375209 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-a1891d94-36fb-4cbb-a64b-9c4b0e3ec1e9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:16:46.376729 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-a1891d94-36fb-4cbb-a64b-9c4b0e3ec1e9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:16:46.398587 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a1891d94-36fb-4cbb-a64b-9c4b0e3ec1e9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:46.399298 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a1891d94-36fb-4cbb-a64b-9c4b0e3ec1e9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:46.400605 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a1891d94-36fb-4cbb-a64b-9c4b0e3ec1e9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:46.401590 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a1891d94-36fb-4cbb-a64b-9c4b0e3ec1e9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:46.556270 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-a1891d94-36fb-4cbb-a64b-9c4b0e3ec1e9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action" status: 200 len: 28187 microversion: 2.20 time: 0.184795 Dec 14 03:16:46.557617 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 144/287] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:16:46 2021] POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action => generated 28187 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:16:46.720990 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-5bdcf263-b892-4275-a434-30786a67f16d tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:16:46.730445 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-5bdcf263-b892-4275-a434-30786a67f16d tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef" status: 200 len: 1521 microversion: 2.1 time: 0.402300 Dec 14 03:16:46.740588 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 144/288] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:16:46 2021] GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef => generated 1521 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 03:16:47.380382 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-fab41bef-6d01-4490-9825-8bd1bae974cf tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:16:47.381398 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-fab41bef-6d01-4490-9825-8bd1bae974cf tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:16:47.388197 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-fab41bef-6d01-4490-9825-8bd1bae974cf tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:47.388728 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-fab41bef-6d01-4490-9825-8bd1bae974cf tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:47.389627 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-fab41bef-6d01-4490-9825-8bd1bae974cf tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:47.389945 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-fab41bef-6d01-4490-9825-8bd1bae974cf tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:47.569197 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-956c8ce2-8ff5-459f-9e0d-9bbb8167c589 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:16:47.570112 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-956c8ce2-8ff5-459f-9e0d-9bbb8167c589 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:16:47.580558 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-956c8ce2-8ff5-459f-9e0d-9bbb8167c589 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:47.581029 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-956c8ce2-8ff5-459f-9e0d-9bbb8167c589 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:47.584599 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-956c8ce2-8ff5-459f-9e0d-9bbb8167c589 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:47.584961 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-956c8ce2-8ff5-459f-9e0d-9bbb8167c589 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:52.092517 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-956c8ce2-8ff5-459f-9e0d-9bbb8167c589 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action" status: 200 len: 28187 microversion: 2.20 time: 4.527375 Dec 14 03:16:52.093641 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 145/289] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:16:47 2021] POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action => generated 28187 bytes in 4529 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:16:52.100918 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-fcb9a9f6-48ab-4563-9d08-160665499f53 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:16:52.103173 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-fcb9a9f6-48ab-4563-9d08-160665499f53 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: 4687b559-c95a-4b82-a076-a7468c10ebef] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:16:52.113781 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-fcb9a9f6-48ab-4563-9d08-160665499f53 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:52.114432 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-fcb9a9f6-48ab-4563-9d08-160665499f53 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:52.115286 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-fcb9a9f6-48ab-4563-9d08-160665499f53 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:52.119315 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-fcb9a9f6-48ab-4563-9d08-160665499f53 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:52.121165 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-fab41bef-6d01-4490-9825-8bd1bae974cf tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action" status: 200 len: 28139 microversion: 2.1 time: 4.744468 Dec 14 03:16:52.125622 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 145/290] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:16:47 2021] POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action => generated 28139 bytes in 4750 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:16:52.328837 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-fcb9a9f6-48ab-4563-9d08-160665499f53 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:16:52.343028 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-fcb9a9f6-48ab-4563-9d08-160665499f53 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef" status: 200 len: 1521 microversion: 2.1 time: 0.248065 Dec 14 03:16:52.343642 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 146/291] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:16:52 2021] GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef => generated 1521 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:16:53.104877 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-41d51b9b-7285-4509-984d-ff9d7ac8be60 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:16:53.106065 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-41d51b9b-7285-4509-984d-ff9d7ac8be60 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:16:53.116755 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-41d51b9b-7285-4509-984d-ff9d7ac8be60 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:53.117746 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-41d51b9b-7285-4509-984d-ff9d7ac8be60 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:53.118853 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-41d51b9b-7285-4509-984d-ff9d7ac8be60 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:53.119477 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-41d51b9b-7285-4509-984d-ff9d7ac8be60 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:53.133629 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-320b2e36-b77a-49d5-b233-30aa71775bbc tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:16:53.135576 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-320b2e36-b77a-49d5-b233-30aa71775bbc tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:16:53.145269 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-320b2e36-b77a-49d5-b233-30aa71775bbc tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:53.147565 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-320b2e36-b77a-49d5-b233-30aa71775bbc tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:53.148537 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-320b2e36-b77a-49d5-b233-30aa71775bbc tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:53.152514 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-320b2e36-b77a-49d5-b233-30aa71775bbc tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:53.251773 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-41d51b9b-7285-4509-984d-ff9d7ac8be60 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action" status: 200 len: 28187 microversion: 2.20 time: 0.150918 Dec 14 03:16:53.253658 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 146/292] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:16:53 2021] POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action => generated 28187 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:16:53.313150 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-320b2e36-b77a-49d5-b233-30aa71775bbc tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action" status: 200 len: 28139 microversion: 2.1 time: 0.183182 Dec 14 03:16:53.317267 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 147/293] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:16:53 2021] POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action => generated 28139 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:16:53.319444 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-c1ba8d61-b7ef-4fb1-8fae-258551b19235 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-595865675", "imageRef": "4fff76a9-6620-4bda-b1ec-2cd3719c946a", "flavorRef": "452", "networks": [{"uuid": "69a3889e-636a-4983-9398-edafd7db5301"}]}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:16:53.361783 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-cf1eb46b-a544-4c2c-a09c-17615112e934 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:16:53.363713 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-cf1eb46b-a544-4c2c-a09c-17615112e934 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: 4687b559-c95a-4b82-a076-a7468c10ebef] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:16:53.377043 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-cf1eb46b-a544-4c2c-a09c-17615112e934 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:53.382613 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-cf1eb46b-a544-4c2c-a09c-17615112e934 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:53.397962 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-cf1eb46b-a544-4c2c-a09c-17615112e934 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:53.399227 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-cf1eb46b-a544-4c2c-a09c-17615112e934 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:53.567833 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-cf1eb46b-a544-4c2c-a09c-17615112e934 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:16:53.576034 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-cf1eb46b-a544-4c2c-a09c-17615112e934 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef" status: 200 len: 1521 microversion: 2.1 time: 0.218857 Dec 14 03:16:53.579425 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 148/294] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:16:53 2021] GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 03:16:54.264918 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-b5bc41b4-7d67-4b89-8ea1-5e10218a6600 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:16:54.265852 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-b5bc41b4-7d67-4b89-8ea1-5e10218a6600 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:16:54.272767 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b5bc41b4-7d67-4b89-8ea1-5e10218a6600 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:54.273479 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b5bc41b4-7d67-4b89-8ea1-5e10218a6600 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:54.274470 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b5bc41b4-7d67-4b89-8ea1-5e10218a6600 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:54.275101 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b5bc41b4-7d67-4b89-8ea1-5e10218a6600 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:54.444143 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-b5bc41b4-7d67-4b89-8ea1-5e10218a6600 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action" status: 200 len: 28187 microversion: 2.20 time: 0.180331 Dec 14 03:16:54.444841 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 149/295] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:16:54 2021] POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action => generated 28187 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 14 03:16:54.452161 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-b270be0c-7770-4d73-9408-7721b4543a73 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:16:54.461790 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-b270be0c-7770-4d73-9408-7721b4543a73 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:16:54.468938 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b270be0c-7770-4d73-9408-7721b4543a73 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:54.469610 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b270be0c-7770-4d73-9408-7721b4543a73 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:54.470575 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b270be0c-7770-4d73-9408-7721b4543a73 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:54.471376 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b270be0c-7770-4d73-9408-7721b4543a73 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:54.614351 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-b270be0c-7770-4d73-9408-7721b4543a73 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action" status: 200 len: 28139 microversion: 2.1 time: 0.167201 Dec 14 03:16:54.615860 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 150/296] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:16:54 2021] POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action => generated 28139 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:16:54.624711 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-c7e2bf62-a2d6-40b4-a557-f7868800a713 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:16:54.625759 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-c7e2bf62-a2d6-40b4-a557-f7868800a713 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: 4687b559-c95a-4b82-a076-a7468c10ebef] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:16:54.634054 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c7e2bf62-a2d6-40b4-a557-f7868800a713 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:54.634927 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c7e2bf62-a2d6-40b4-a557-f7868800a713 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:54.635756 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c7e2bf62-a2d6-40b4-a557-f7868800a713 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:54.636358 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c7e2bf62-a2d6-40b4-a557-f7868800a713 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:54.814921 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-c7e2bf62-a2d6-40b4-a557-f7868800a713 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:16:54.822746 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-c7e2bf62-a2d6-40b4-a557-f7868800a713 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef" status: 200 len: 1521 microversion: 2.1 time: 0.205414 Dec 14 03:16:54.824608 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 151/297] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:16:54 2021] GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:16:55.457539 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-4af4ae79-ef84-45d3-88da-86648fb5da2d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:16:55.459393 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-4af4ae79-ef84-45d3-88da-86648fb5da2d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:16:55.468973 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4af4ae79-ef84-45d3-88da-86648fb5da2d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:55.471092 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4af4ae79-ef84-45d3-88da-86648fb5da2d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:55.474227 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4af4ae79-ef84-45d3-88da-86648fb5da2d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:55.476937 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4af4ae79-ef84-45d3-88da-86648fb5da2d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:55.613331 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-4af4ae79-ef84-45d3-88da-86648fb5da2d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action" status: 200 len: 28187 microversion: 2.20 time: 0.158859 Dec 14 03:16:55.621379 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 152/298] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:16:55 2021] POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action => generated 28187 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 14 03:16:55.627382 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-96ccdc93-bf10-4719-a06b-5c73505fdb08 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:16:55.640226 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-96ccdc93-bf10-4719-a06b-5c73505fdb08 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:16:55.648686 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-96ccdc93-bf10-4719-a06b-5c73505fdb08 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:55.649618 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-96ccdc93-bf10-4719-a06b-5c73505fdb08 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:55.650606 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-96ccdc93-bf10-4719-a06b-5c73505fdb08 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:55.651873 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-96ccdc93-bf10-4719-a06b-5c73505fdb08 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:55.775360 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-96ccdc93-bf10-4719-a06b-5c73505fdb08 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action" status: 200 len: 28139 microversion: 2.1 time: 0.151928 Dec 14 03:16:55.776720 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 153/299] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:16:55 2021] POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action => generated 28139 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:16:55.846520 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-b3757fd2-51a2-4724-aed4-72a374188184 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:16:55.847609 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-b3757fd2-51a2-4724-aed4-72a374188184 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: 4687b559-c95a-4b82-a076-a7468c10ebef] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:16:55.857233 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b3757fd2-51a2-4724-aed4-72a374188184 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:55.857977 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b3757fd2-51a2-4724-aed4-72a374188184 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:55.859144 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b3757fd2-51a2-4724-aed4-72a374188184 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:55.859737 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b3757fd2-51a2-4724-aed4-72a374188184 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:56.122827 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-b3757fd2-51a2-4724-aed4-72a374188184 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:16:56.131936 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-b3757fd2-51a2-4724-aed4-72a374188184 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef" status: 200 len: 1521 microversion: 2.1 time: 0.289805 Dec 14 03:16:56.133170 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 154/300] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:16:55 2021] GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef => generated 1521 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 03:16:56.626809 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-cfc473e1-5697-468f-97ae-b540cc564794 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:16:56.628535 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-cfc473e1-5697-468f-97ae-b540cc564794 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:16:56.648041 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-cfc473e1-5697-468f-97ae-b540cc564794 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:56.648325 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-cfc473e1-5697-468f-97ae-b540cc564794 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:56.649284 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-cfc473e1-5697-468f-97ae-b540cc564794 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:56.649727 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-cfc473e1-5697-468f-97ae-b540cc564794 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:56.792204 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-cfc473e1-5697-468f-97ae-b540cc564794 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action" status: 200 len: 28187 microversion: 2.20 time: 0.168866 Dec 14 03:16:56.792941 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 155/301] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:16:56 2021] POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action => generated 28187 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:16:56.797945 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-1bbf66f5-de4a-466b-a10d-e25538382c46 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:16:56.799167 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-1bbf66f5-de4a-466b-a10d-e25538382c46 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:16:56.806703 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1bbf66f5-de4a-466b-a10d-e25538382c46 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:56.807261 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1bbf66f5-de4a-466b-a10d-e25538382c46 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:56.808263 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1bbf66f5-de4a-466b-a10d-e25538382c46 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:56.808753 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1bbf66f5-de4a-466b-a10d-e25538382c46 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:56.923275 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-1bbf66f5-de4a-466b-a10d-e25538382c46 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action" status: 200 len: 28139 microversion: 2.1 time: 0.128735 Dec 14 03:16:56.927087 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 156/302] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:16:56 2021] POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action => generated 28139 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:16:57.149467 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-8cb1d702-0f71-4a08-bf7a-74fda5af2e9b tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:16:57.150165 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-8cb1d702-0f71-4a08-bf7a-74fda5af2e9b tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: 4687b559-c95a-4b82-a076-a7468c10ebef] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:16:57.156962 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8cb1d702-0f71-4a08-bf7a-74fda5af2e9b tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:57.157409 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8cb1d702-0f71-4a08-bf7a-74fda5af2e9b tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:57.158196 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8cb1d702-0f71-4a08-bf7a-74fda5af2e9b tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:57.158630 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8cb1d702-0f71-4a08-bf7a-74fda5af2e9b tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:57.336480 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-8cb1d702-0f71-4a08-bf7a-74fda5af2e9b tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:16:57.356967 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-8cb1d702-0f71-4a08-bf7a-74fda5af2e9b tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef" status: 200 len: 1521 microversion: 2.1 time: 0.211244 Dec 14 03:16:57.357781 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 157/303] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:16:57 2021] GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:16:57.805152 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-dd929418-eb65-47e0-abbc-8de2aab28307 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:16:57.806236 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-dd929418-eb65-47e0-abbc-8de2aab28307 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:16:57.821112 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-dd929418-eb65-47e0-abbc-8de2aab28307 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:57.821652 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-dd929418-eb65-47e0-abbc-8de2aab28307 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:57.824104 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-dd929418-eb65-47e0-abbc-8de2aab28307 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:57.824737 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-dd929418-eb65-47e0-abbc-8de2aab28307 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:57.958078 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-dd929418-eb65-47e0-abbc-8de2aab28307 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action" status: 200 len: 28187 microversion: 2.20 time: 0.156849 Dec 14 03:16:57.962942 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 158/304] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:16:57 2021] POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action => generated 28187 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:16:57.968725 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-6c2e6c73-3887-4f03-b533-a1e8ed88bbe0 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:16:57.975007 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-6c2e6c73-3887-4f03-b533-a1e8ed88bbe0 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:16:57.987149 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6c2e6c73-3887-4f03-b533-a1e8ed88bbe0 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:57.988370 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6c2e6c73-3887-4f03-b533-a1e8ed88bbe0 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:57.989159 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6c2e6c73-3887-4f03-b533-a1e8ed88bbe0 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:57.989599 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6c2e6c73-3887-4f03-b533-a1e8ed88bbe0 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:58.106800 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-6c2e6c73-3887-4f03-b533-a1e8ed88bbe0 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action" status: 200 len: 28139 microversion: 2.1 time: 0.141732 Dec 14 03:16:58.122608 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 159/305] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:16:57 2021] POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action => generated 28139 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:16:58.377854 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-35c32a9e-e3e1-4c25-89d4-0e921d9d4c5b tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:16:58.380598 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-35c32a9e-e3e1-4c25-89d4-0e921d9d4c5b tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: 4687b559-c95a-4b82-a076-a7468c10ebef] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:16:58.393199 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-35c32a9e-e3e1-4c25-89d4-0e921d9d4c5b tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:58.393700 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-35c32a9e-e3e1-4c25-89d4-0e921d9d4c5b tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:58.394486 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-35c32a9e-e3e1-4c25-89d4-0e921d9d4c5b tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:58.398760 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-35c32a9e-e3e1-4c25-89d4-0e921d9d4c5b tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:58.586253 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-35c32a9e-e3e1-4c25-89d4-0e921d9d4c5b tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:16:58.637747 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-35c32a9e-e3e1-4c25-89d4-0e921d9d4c5b tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef" status: 200 len: 1521 microversion: 2.1 time: 0.264993 Dec 14 03:16:58.655099 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 160/306] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:16:58 2021] GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef => generated 1521 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 03:16:58.971524 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-470f7f55-a055-443a-a96a-fddf4ee9577b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:16:58.973403 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-470f7f55-a055-443a-a96a-fddf4ee9577b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:16:58.986088 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-470f7f55-a055-443a-a96a-fddf4ee9577b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:58.988376 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-470f7f55-a055-443a-a96a-fddf4ee9577b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:58.989369 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-470f7f55-a055-443a-a96a-fddf4ee9577b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:58.989989 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-470f7f55-a055-443a-a96a-fddf4ee9577b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:59.117277 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-470f7f55-a055-443a-a96a-fddf4ee9577b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action" status: 200 len: 28187 microversion: 2.20 time: 0.150770 Dec 14 03:16:59.121088 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 161/307] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:16:58 2021] POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action => generated 28187 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:16:59.128533 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-6a3194ff-1fd6-4c48-a343-4b86952e9b0c tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:16:59.130396 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-6a3194ff-1fd6-4c48-a343-4b86952e9b0c tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:16:59.137840 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6a3194ff-1fd6-4c48-a343-4b86952e9b0c tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:59.138520 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6a3194ff-1fd6-4c48-a343-4b86952e9b0c tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:59.139349 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6a3194ff-1fd6-4c48-a343-4b86952e9b0c tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:59.140045 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6a3194ff-1fd6-4c48-a343-4b86952e9b0c tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:59.251312 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-6a3194ff-1fd6-4c48-a343-4b86952e9b0c tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action" status: 200 len: 28139 microversion: 2.1 time: 0.124705 Dec 14 03:16:59.251312 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 162/308] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:16:59 2021] POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action => generated 28139 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:16:59.661618 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-084df45b-9da7-4dd4-8ee0-7f187ac35fc7 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:16:59.662037 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-084df45b-9da7-4dd4-8ee0-7f187ac35fc7 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: 4687b559-c95a-4b82-a076-a7468c10ebef] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:16:59.669482 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-084df45b-9da7-4dd4-8ee0-7f187ac35fc7 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:59.669965 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-084df45b-9da7-4dd4-8ee0-7f187ac35fc7 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:59.670758 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-084df45b-9da7-4dd4-8ee0-7f187ac35fc7 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:16:59.671224 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-084df45b-9da7-4dd4-8ee0-7f187ac35fc7 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:16:59.788967 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.network.neutron [None req-c1ba8d61-b7ef-4fb1-8fae-258551b19235 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] validate_networks() for [('69a3889e-636a-4983-9398-edafd7db5301', None, None, None, None, None)] {{(pid=116071) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 14 03:16:59.815426 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-084df45b-9da7-4dd4-8ee0-7f187ac35fc7 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:16:59.822886 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-084df45b-9da7-4dd4-8ee0-7f187ac35fc7 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef" status: 200 len: 1521 microversion: 2.1 time: 0.166552 Dec 14 03:16:59.823485 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 163/309] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:16:59 2021] GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:17:00.129551 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-111c26e8-9f81-4060-9ad9-c64a15d8c1dd tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:17:00.131840 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-111c26e8-9f81-4060-9ad9-c64a15d8c1dd tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:00.143230 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-111c26e8-9f81-4060-9ad9-c64a15d8c1dd tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:00.144738 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-111c26e8-9f81-4060-9ad9-c64a15d8c1dd tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:00.145756 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-111c26e8-9f81-4060-9ad9-c64a15d8c1dd tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:00.146382 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-111c26e8-9f81-4060-9ad9-c64a15d8c1dd tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:00.277481 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-111c26e8-9f81-4060-9ad9-c64a15d8c1dd tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action" status: 200 len: 28187 microversion: 2.20 time: 0.151941 Dec 14 03:17:00.281441 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 164/310] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:17:00 2021] POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action => generated 28187 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:17:00.283345 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-a67bae15-109f-44c3-91da-aec3f45a6f86 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:17:00.284318 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-a67bae15-109f-44c3-91da-aec3f45a6f86 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:00.301455 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a67bae15-109f-44c3-91da-aec3f45a6f86 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:00.301912 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a67bae15-109f-44c3-91da-aec3f45a6f86 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:00.302838 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a67bae15-109f-44c3-91da-aec3f45a6f86 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:00.303318 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a67bae15-109f-44c3-91da-aec3f45a6f86 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:00.413821 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-a67bae15-109f-44c3-91da-aec3f45a6f86 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action" status: 200 len: 28139 microversion: 2.1 time: 0.134291 Dec 14 03:17:00.420706 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 165/311] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:17:00 2021] POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action => generated 28139 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:17:00.453203 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.virt.hardware [None req-c1ba8d61-b7ef-4fb1-8fae-258551b19235 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Flavor limits 0:0:0 {{(pid=116071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 14 03:17:00.453628 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.virt.hardware [None req-c1ba8d61-b7ef-4fb1-8fae-258551b19235 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Image limits 0:0:0 {{(pid=116071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 14 03:17:00.454097 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.virt.hardware [None req-c1ba8d61-b7ef-4fb1-8fae-258551b19235 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Flavor pref 0:0:0 {{(pid=116071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 14 03:17:00.454502 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.virt.hardware [None req-c1ba8d61-b7ef-4fb1-8fae-258551b19235 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Image pref 0:0:0 {{(pid=116071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 14 03:17:00.454909 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.virt.hardware [None req-c1ba8d61-b7ef-4fb1-8fae-258551b19235 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 14 03:17:00.464555 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c1ba8d61-b7ef-4fb1-8fae-258551b19235 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:00.465230 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c1ba8d61-b7ef-4fb1-8fae-258551b19235 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:00.466203 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c1ba8d61-b7ef-4fb1-8fae-258551b19235 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:00.466657 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c1ba8d61-b7ef-4fb1-8fae-258551b19235 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:00.483614 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.quota [None req-c1ba8d61-b7ef-4fb1-8fae-258551b19235 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Getting quotas for project 7ecea5c13a624ab8a3a445d3ede5fd77. Resources: {'cores', 'instances', 'ram'} {{(pid=116071) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 03:17:00.489456 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.quota [None req-c1ba8d61-b7ef-4fb1-8fae-258551b19235 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Getting quotas for user 0a133cb1175e4130902bbcdeaedd74f9 and project 7ecea5c13a624ab8a3a445d3ede5fd77. Resources: {'cores', 'instances', 'ram'} {{(pid=116071) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 03:17:00.501166 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-c1ba8d61-b7ef-4fb1-8fae-258551b19235 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Going to run 1 instances... {{(pid=116071) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 14 03:17:00.504521 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-c1ba8d61-b7ef-4fb1-8fae-258551b19235 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4fff76a9-6620-4bda-b1ec-2cd3719c946a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 14 03:17:00.558726 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-c1ba8d61-b7ef-4fb1-8fae-258551b19235 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 7.243552 Dec 14 03:17:00.565270 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 147/312] 10.222.0.43 () {60 vars in 1146 bytes} [Tue Dec 14 03:16:53 2021] POST /compute/v2.1/servers => generated 380 bytes in 7251 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 14 03:17:00.572837 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-98b25de1-52e3-41b5-b5a7-e0bfbfcfbba0 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:17:00.573544 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-98b25de1-52e3-41b5-b5a7-e0bfbfcfbba0 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:00.705925 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-98b25de1-52e3-41b5-b5a7-e0bfbfcfbba0 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:17:00.714395 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-98b25de1-52e3-41b5-b5a7-e0bfbfcfbba0 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe" status: 200 len: 1217 microversion: 2.1 time: 0.147207 Dec 14 03:17:00.715585 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 166/313] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:17:00 2021] GET /compute/v2.1/servers/e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe => generated 1217 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 03:17:00.850466 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-8d938318-e4dc-48c8-a0fb-c0a03f8b0b19 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:17:00.851471 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-8d938318-e4dc-48c8-a0fb-c0a03f8b0b19 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: 4687b559-c95a-4b82-a076-a7468c10ebef] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:00.859082 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-8d938318-e4dc-48c8-a0fb-c0a03f8b0b19 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:00.859765 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-8d938318-e4dc-48c8-a0fb-c0a03f8b0b19 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:00.860898 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-8d938318-e4dc-48c8-a0fb-c0a03f8b0b19 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:00.861504 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-8d938318-e4dc-48c8-a0fb-c0a03f8b0b19 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:01.052613 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-8d938318-e4dc-48c8-a0fb-c0a03f8b0b19 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:17:01.062389 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-8d938318-e4dc-48c8-a0fb-c0a03f8b0b19 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef" status: 200 len: 1521 microversion: 2.1 time: 0.224248 Dec 14 03:17:01.063494 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 148/314] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:17:00 2021] GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef => generated 1521 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:17:01.289980 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-252515f8-4f76-48f8-9c7a-9ceff5e58844 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:17:01.291727 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-252515f8-4f76-48f8-9c7a-9ceff5e58844 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:01.298955 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-252515f8-4f76-48f8-9c7a-9ceff5e58844 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:01.300351 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-252515f8-4f76-48f8-9c7a-9ceff5e58844 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:01.301480 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-252515f8-4f76-48f8-9c7a-9ceff5e58844 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:01.302066 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-252515f8-4f76-48f8-9c7a-9ceff5e58844 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:01.421134 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-252515f8-4f76-48f8-9c7a-9ceff5e58844 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action" status: 200 len: 28431 microversion: 2.20 time: 0.134653 Dec 14 03:17:01.422844 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 167/315] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:17:01 2021] POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action => generated 28431 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:17:01.428973 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-09ab97c0-dbc5-4361-bef5-1b188ffdd939 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:17:01.430131 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-09ab97c0-dbc5-4361-bef5-1b188ffdd939 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:01.437421 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-09ab97c0-dbc5-4361-bef5-1b188ffdd939 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:01.438174 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-09ab97c0-dbc5-4361-bef5-1b188ffdd939 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:01.439224 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-09ab97c0-dbc5-4361-bef5-1b188ffdd939 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:01.439882 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-09ab97c0-dbc5-4361-bef5-1b188ffdd939 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:01.560057 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-09ab97c0-dbc5-4361-bef5-1b188ffdd939 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action" status: 200 len: 28139 microversion: 2.1 time: 0.135029 Dec 14 03:17:01.560707 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 149/316] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:17:01 2021] POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action => generated 28139 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:17:01.732377 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-2381d8f6-79f4-414d-ba76-03f8796bc0a1 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:17:01.733458 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-2381d8f6-79f4-414d-ba76-03f8796bc0a1 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:01.746539 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2381d8f6-79f4-414d-ba76-03f8796bc0a1 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:01.747090 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2381d8f6-79f4-414d-ba76-03f8796bc0a1 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:01.748111 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2381d8f6-79f4-414d-ba76-03f8796bc0a1 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:01.748602 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2381d8f6-79f4-414d-ba76-03f8796bc0a1 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:01.817227 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-2381d8f6-79f4-414d-ba76-03f8796bc0a1 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:17:01.826448 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-2381d8f6-79f4-414d-ba76-03f8796bc0a1 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe" status: 200 len: 1269 microversion: 2.1 time: 0.097753 Dec 14 03:17:01.840011 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 168/317] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:17:01 2021] GET /compute/v2.1/servers/e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe => generated 1269 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:17:02.083723 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-68192f5c-1384-4e2d-a3b0-fe925ac6eeb4 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:17:02.090479 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-68192f5c-1384-4e2d-a3b0-fe925ac6eeb4 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: 4687b559-c95a-4b82-a076-a7468c10ebef] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:02.104482 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-68192f5c-1384-4e2d-a3b0-fe925ac6eeb4 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:02.108852 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-68192f5c-1384-4e2d-a3b0-fe925ac6eeb4 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:02.109879 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-68192f5c-1384-4e2d-a3b0-fe925ac6eeb4 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:02.114161 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-68192f5c-1384-4e2d-a3b0-fe925ac6eeb4 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:02.279486 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-68192f5c-1384-4e2d-a3b0-fe925ac6eeb4 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:17:02.288297 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-68192f5c-1384-4e2d-a3b0-fe925ac6eeb4 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef" status: 200 len: 1521 microversion: 2.1 time: 0.209257 Dec 14 03:17:02.288724 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 150/318] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:17:02 2021] GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef => generated 1521 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:17:02.433636 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-c025edb6-ac0d-4ca4-97a5-10a13434c6d1 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:17:02.434601 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-c025edb6-ac0d-4ca4-97a5-10a13434c6d1 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:02.441599 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c025edb6-ac0d-4ca4-97a5-10a13434c6d1 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:02.442048 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c025edb6-ac0d-4ca4-97a5-10a13434c6d1 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:02.443029 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c025edb6-ac0d-4ca4-97a5-10a13434c6d1 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:02.443641 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c025edb6-ac0d-4ca4-97a5-10a13434c6d1 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:02.574041 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-7d914738-67a1-45c2-a3de-86899436bb3c tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:17:02.575589 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-7d914738-67a1-45c2-a3de-86899436bb3c tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:02.585673 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-7d914738-67a1-45c2-a3de-86899436bb3c tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:02.588113 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-7d914738-67a1-45c2-a3de-86899436bb3c tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:02.592061 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-7d914738-67a1-45c2-a3de-86899436bb3c tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:02.592740 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-7d914738-67a1-45c2-a3de-86899436bb3c tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:02.640132 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-c025edb6-ac0d-4ca4-97a5-10a13434c6d1 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action" status: 200 len: 28478 microversion: 2.20 time: 0.209459 Dec 14 03:17:02.641013 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 169/319] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:17:02 2021] POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action => generated 28478 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:17:02.837819 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-64459cd0-6046-40d5-85c0-4a1f331fcb7f tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Action: 'create', calling method: .version_select at 0x7fa5081abaf0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1501747943"}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:17:02.860002 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.quota [None req-64459cd0-6046-40d5-85c0-4a1f331fcb7f tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Getting quotas for project bc2e5ee76edf4e358f418773bf824ed7. Resources: {'key_pairs'} {{(pid=116072) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 03:17:02.865049 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.quota [None req-64459cd0-6046-40d5-85c0-4a1f331fcb7f tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Getting quotas for user f1d620fa9da54f588f753b3c497f00c7 and project bc2e5ee76edf4e358f418773bf824ed7. Resources: {'key_pairs'} {{(pid=116072) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 03:17:03.092019 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.quota [None req-64459cd0-6046-40d5-85c0-4a1f331fcb7f tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Getting quotas for project bc2e5ee76edf4e358f418773bf824ed7. Resources: {'key_pairs'} {{(pid=116072) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 03:17:03.095959 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.quota [None req-64459cd0-6046-40d5-85c0-4a1f331fcb7f tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Getting quotas for user f1d620fa9da54f588f753b3c497f00c7 and project bc2e5ee76edf4e358f418773bf824ed7. Resources: {'key_pairs'} {{(pid=116072) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 03:17:03.110027 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-64459cd0-6046-40d5-85c0-4a1f331fcb7f tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.276463 Dec 14 03:17:03.110658 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 170/320] 10.222.0.43 () {60 vars in 1157 bytes} [Tue Dec 14 03:17:02 2021] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 03:17:03.115915 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-b69d7d56-c422-4c1e-8fbd-2022438eecef tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:17:03.116643 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-b69d7d56-c422-4c1e-8fbd-2022438eecef tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:03.123439 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b69d7d56-c422-4c1e-8fbd-2022438eecef tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:03.123439 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b69d7d56-c422-4c1e-8fbd-2022438eecef tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:03.124086 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b69d7d56-c422-4c1e-8fbd-2022438eecef tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:03.124520 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b69d7d56-c422-4c1e-8fbd-2022438eecef tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:03.253797 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-b69d7d56-c422-4c1e-8fbd-2022438eecef tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:17:03.260902 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-b69d7d56-c422-4c1e-8fbd-2022438eecef tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe" status: 200 len: 1317 microversion: 2.1 time: 0.149274 Dec 14 03:17:03.261453 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 171/321] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:17:03 2021] GET /compute/v2.1/servers/e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe => generated 1317 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:17:03.265598 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-8c254d08-0032-461a-8bc4-445c2a5ed44c tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1374782797", "imageRef": "25cb82ee-7dbc-45b7-a611-4d789bdfa325", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1501747943", "networks": [{"uuid": "f2ccc364-1044-4d86-92a1-159741b0fffd"}]}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:17:03.315938 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.network.neutron [None req-8c254d08-0032-461a-8bc4-445c2a5ed44c tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] validate_networks() for [('f2ccc364-1044-4d86-92a1-159741b0fffd', None, None, None, None, None)] {{(pid=116072) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 14 03:17:03.670447 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-8c254d08-0032-461a-8bc4-445c2a5ed44c tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Flavor limits 0:0:0 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 14 03:17:03.670973 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-8c254d08-0032-461a-8bc4-445c2a5ed44c tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Image limits 0:0:0 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 14 03:17:03.671409 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-8c254d08-0032-461a-8bc4-445c2a5ed44c tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Flavor pref 0:0:0 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 14 03:17:03.671819 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-8c254d08-0032-461a-8bc4-445c2a5ed44c tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Image pref 0:0:0 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 14 03:17:03.672258 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-8c254d08-0032-461a-8bc4-445c2a5ed44c tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 14 03:17:03.681508 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8c254d08-0032-461a-8bc4-445c2a5ed44c tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:03.681895 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8c254d08-0032-461a-8bc4-445c2a5ed44c tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:03.682714 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8c254d08-0032-461a-8bc4-445c2a5ed44c tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:03.683183 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8c254d08-0032-461a-8bc4-445c2a5ed44c tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:03.698947 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.quota [None req-8c254d08-0032-461a-8bc4-445c2a5ed44c tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Getting quotas for project bc2e5ee76edf4e358f418773bf824ed7. Resources: {'cores', 'instances', 'ram'} {{(pid=116072) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 03:17:03.702866 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.quota [None req-8c254d08-0032-461a-8bc4-445c2a5ed44c tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Getting quotas for user f1d620fa9da54f588f753b3c497f00c7 and project bc2e5ee76edf4e358f418773bf824ed7. Resources: {'cores', 'instances', 'ram'} {{(pid=116072) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 03:17:03.713599 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-8c254d08-0032-461a-8bc4-445c2a5ed44c tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Going to run 1 instances... {{(pid=116072) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 14 03:17:03.715902 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-8c254d08-0032-461a-8bc4-445c2a5ed44c tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] [instance: cfd2456c-8f28-4be0-9c97-8e03b0fec041] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='25cb82ee-7dbc-45b7-a611-4d789bdfa325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 14 03:17:03.760520 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-8c254d08-0032-461a-8bc4-445c2a5ed44c tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.498074 Dec 14 03:17:03.761155 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 172/322] 10.222.0.43 () {60 vars in 1146 bytes} [Tue Dec 14 03:17:03 2021] POST /compute/v2.1/servers => generated 380 bytes in 499 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 14 03:17:03.765305 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-aa855312-c33e-403d-bd7d-a25e2c953957 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:17:03.766166 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-aa855312-c33e-403d-bd7d-a25e2c953957 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: 4687b559-c95a-4b82-a076-a7468c10ebef] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:03.772560 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-aa855312-c33e-403d-bd7d-a25e2c953957 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:03.773015 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-aa855312-c33e-403d-bd7d-a25e2c953957 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:03.773793 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-aa855312-c33e-403d-bd7d-a25e2c953957 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:03.774231 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-aa855312-c33e-403d-bd7d-a25e2c953957 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:03.905078 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-aa855312-c33e-403d-bd7d-a25e2c953957 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:17:03.913414 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-aa855312-c33e-403d-bd7d-a25e2c953957 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef" status: 200 len: 1521 microversion: 2.1 time: 0.151235 Dec 14 03:17:03.914091 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 173/323] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:17:03 2021] GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:17:03.918720 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-68b9b57a-1e06-451b-89dc-df295bdbad6f tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:17:03.919711 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-68b9b57a-1e06-451b-89dc-df295bdbad6f tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:03.926678 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-68b9b57a-1e06-451b-89dc-df295bdbad6f tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:03.927165 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-68b9b57a-1e06-451b-89dc-df295bdbad6f tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:03.928093 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-68b9b57a-1e06-451b-89dc-df295bdbad6f tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:03.928564 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-68b9b57a-1e06-451b-89dc-df295bdbad6f tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:07.021771 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-68b9b57a-1e06-451b-89dc-df295bdbad6f tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action" status: 200 len: 28583 microversion: 2.20 time: 3.106329 Dec 14 03:17:07.022515 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 174/324] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:17:03 2021] POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action => generated 28583 bytes in 3108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:17:07.027855 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-0e0fad83-6332-4127-bd75-9621297ccc9e tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:17:07.028872 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-0e0fad83-6332-4127-bd75-9621297ccc9e tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] [instance: cfd2456c-8f28-4be0-9c97-8e03b0fec041] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:07.035312 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0e0fad83-6332-4127-bd75-9621297ccc9e tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:07.035748 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0e0fad83-6332-4127-bd75-9621297ccc9e tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:07.036524 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0e0fad83-6332-4127-bd75-9621297ccc9e tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:07.036954 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0e0fad83-6332-4127-bd75-9621297ccc9e tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:07.043104 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-7d914738-67a1-45c2-a3de-86899436bb3c tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action" status: 200 len: 28139 microversion: 2.1 time: 4.474011 Dec 14 03:17:07.044115 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 151/325] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:17:02 2021] POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action => generated 28139 bytes in 4476 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:17:07.061588 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-f0b72a95-757b-4751-83d7-e69e7ab191b5 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:17:07.062815 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-f0b72a95-757b-4751-83d7-e69e7ab191b5 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:07.073271 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-f0b72a95-757b-4751-83d7-e69e7ab191b5 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:07.076064 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-f0b72a95-757b-4751-83d7-e69e7ab191b5 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:07.077075 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-f0b72a95-757b-4751-83d7-e69e7ab191b5 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:07.077678 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-f0b72a95-757b-4751-83d7-e69e7ab191b5 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:07.116301 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-0e0fad83-6332-4127-bd75-9621297ccc9e tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d620fa9da54f588f753b3c497f00c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:17:07.123690 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-0e0fad83-6332-4127-bd75-9621297ccc9e tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041" status: 200 len: 1255 microversion: 2.1 time: 0.099910 Dec 14 03:17:07.124381 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 175/326] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:17:07 2021] GET /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041 => generated 1255 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:17:07.129210 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-fa4f9743-4a5f-4983-95cc-f2c4f54971d2 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:17:07.130032 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-fa4f9743-4a5f-4983-95cc-f2c4f54971d2 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: 4687b559-c95a-4b82-a076-a7468c10ebef] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:07.136048 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-fa4f9743-4a5f-4983-95cc-f2c4f54971d2 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:07.136585 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-fa4f9743-4a5f-4983-95cc-f2c4f54971d2 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:07.138767 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-fa4f9743-4a5f-4983-95cc-f2c4f54971d2 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:07.138767 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-fa4f9743-4a5f-4983-95cc-f2c4f54971d2 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:07.276206 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-f0b72a95-757b-4751-83d7-e69e7ab191b5 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:17:07.284657 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-f0b72a95-757b-4751-83d7-e69e7ab191b5 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe" status: 200 len: 1317 microversion: 2.1 time: 0.238591 Dec 14 03:17:07.285465 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 152/327] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:17:07 2021] GET /compute/v2.1/servers/e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe => generated 1317 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:17:07.321804 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-fa4f9743-4a5f-4983-95cc-f2c4f54971d2 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:17:07.329816 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-fa4f9743-4a5f-4983-95cc-f2c4f54971d2 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef" status: 200 len: 1521 microversion: 2.1 time: 0.204207 Dec 14 03:17:07.330397 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 176/328] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:17:07 2021] GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:17:07.802310 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [req-29fc60d4-ef02-48d3-a383-86cd6b6e3f3f req-ca7b792f-482a-4a74-bc52-394d41fccadd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe", "tag": "9ffbafb8-f71a-4067-8988-a284fbb41603"}]} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:17:07.804052 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:17:07.804052 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: warnings.warn(msg) Dec 14 03:17:07.811398 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [req-29fc60d4-ef02-48d3-a383-86cd6b6e3f3f req-ca7b792f-482a-4a74-bc52-394d41fccadd service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:07.811920 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [req-29fc60d4-ef02-48d3-a383-86cd6b6e3f3f req-ca7b792f-482a-4a74-bc52-394d41fccadd service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:07.826013 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.compute.server_external_events [req-29fc60d4-ef02-48d3-a383-86cd6b6e3f3f req-ca7b792f-482a-4a74-bc52-394d41fccadd service nova] Creating event network-changed:9ffbafb8-f71a-4067-8988-a284fbb41603 for instance e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe on hv-cinder-81803 Dec 14 03:17:07.831400 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [req-29fc60d4-ef02-48d3-a383-86cd6b6e3f3f req-ca7b792f-482a-4a74-bc52-394d41fccadd service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032786 Dec 14 03:17:07.831996 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 153/329] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Dec 14 03:17:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 14 03:17:08.033672 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-a6b2a36a-4f1b-461b-a96b-98bfd55953ee tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:17:08.035345 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-a6b2a36a-4f1b-461b-a96b-98bfd55953ee tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:08.041585 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a6b2a36a-4f1b-461b-a96b-98bfd55953ee tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:08.042039 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a6b2a36a-4f1b-461b-a96b-98bfd55953ee tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:08.042820 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a6b2a36a-4f1b-461b-a96b-98bfd55953ee tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:08.043285 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a6b2a36a-4f1b-461b-a96b-98bfd55953ee tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:08.054627 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-414070dd-92e4-4b30-936d-c3dc76435dbd tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:17:08.055734 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-414070dd-92e4-4b30-936d-c3dc76435dbd tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:08.062206 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-414070dd-92e4-4b30-936d-c3dc76435dbd tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:08.062795 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-414070dd-92e4-4b30-936d-c3dc76435dbd tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:08.064393 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-414070dd-92e4-4b30-936d-c3dc76435dbd tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:08.064792 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-414070dd-92e4-4b30-936d-c3dc76435dbd tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:08.357736 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-a6b2a36a-4f1b-461b-a96b-98bfd55953ee tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action" status: 200 len: 28903 microversion: 2.20 time: 0.327486 Dec 14 03:17:08.358620 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 177/330] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:17:08 2021] POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action => generated 28903 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:17:08.364050 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-c740ccb4-7717-4267-b089-aff8024cd538 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:17:08.364738 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-c740ccb4-7717-4267-b089-aff8024cd538 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] [instance: cfd2456c-8f28-4be0-9c97-8e03b0fec041] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:08.370969 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c740ccb4-7717-4267-b089-aff8024cd538 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:08.371605 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c740ccb4-7717-4267-b089-aff8024cd538 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:08.372404 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c740ccb4-7717-4267-b089-aff8024cd538 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:08.372950 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c740ccb4-7717-4267-b089-aff8024cd538 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:08.402439 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-414070dd-92e4-4b30-936d-c3dc76435dbd tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action" status: 200 len: 28266 microversion: 2.1 time: 0.351856 Dec 14 03:17:08.403314 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 154/331] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:17:08 2021] POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action => generated 28266 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:17:08.412001 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-c41e6769-0502-4b9e-baf6-560f70f35adb tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:17:08.412704 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-c41e6769-0502-4b9e-baf6-560f70f35adb tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:08.419571 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c41e6769-0502-4b9e-baf6-560f70f35adb tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:08.420017 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c41e6769-0502-4b9e-baf6-560f70f35adb tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:08.421010 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c41e6769-0502-4b9e-baf6-560f70f35adb tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:08.421444 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c41e6769-0502-4b9e-baf6-560f70f35adb tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:08.436274 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-c740ccb4-7717-4267-b089-aff8024cd538 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d620fa9da54f588f753b3c497f00c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:17:08.444170 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-c740ccb4-7717-4267-b089-aff8024cd538 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041" status: 200 len: 1311 microversion: 2.1 time: 0.084579 Dec 14 03:17:08.444737 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 178/332] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:17:08 2021] GET /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041 => generated 1311 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:17:08.449391 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-df2c218a-5767-4ac0-8621-7828637f399b tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:17:08.450173 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-df2c218a-5767-4ac0-8621-7828637f399b tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: 4687b559-c95a-4b82-a076-a7468c10ebef] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:08.456348 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-df2c218a-5767-4ac0-8621-7828637f399b tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:08.456756 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-df2c218a-5767-4ac0-8621-7828637f399b tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:08.457661 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-df2c218a-5767-4ac0-8621-7828637f399b tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:08.458273 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-df2c218a-5767-4ac0-8621-7828637f399b tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:08.608691 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-c41e6769-0502-4b9e-baf6-560f70f35adb tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:17:08.616414 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-c41e6769-0502-4b9e-baf6-560f70f35adb tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe" status: 200 len: 1317 microversion: 2.1 time: 0.208826 Dec 14 03:17:08.616977 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 155/333] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:17:08 2021] GET /compute/v2.1/servers/e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe => generated 1317 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:17:08.630182 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-df2c218a-5767-4ac0-8621-7828637f399b tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:17:08.637521 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-df2c218a-5767-4ac0-8621-7828637f399b tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef" status: 200 len: 1521 microversion: 2.1 time: 0.191526 Dec 14 03:17:08.638120 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 179/334] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:17:08 2021] GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:17:09.369891 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-1111661f-a792-412d-991f-73132ddb721f tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:17:09.371589 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-1111661f-a792-412d-991f-73132ddb721f tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:09.382611 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-1111661f-a792-412d-991f-73132ddb721f tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:09.383158 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-1111661f-a792-412d-991f-73132ddb721f tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:09.384016 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-1111661f-a792-412d-991f-73132ddb721f tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:09.384464 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-1111661f-a792-412d-991f-73132ddb721f tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:09.416763 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-964b459e-1b2a-471f-93f0-08fd477007f0 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:17:09.417868 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-964b459e-1b2a-471f-93f0-08fd477007f0 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:09.427144 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-964b459e-1b2a-471f-93f0-08fd477007f0 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:09.428051 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-964b459e-1b2a-471f-93f0-08fd477007f0 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:09.429245 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-964b459e-1b2a-471f-93f0-08fd477007f0 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:09.430346 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-964b459e-1b2a-471f-93f0-08fd477007f0 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:09.911548 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-964b459e-1b2a-471f-93f0-08fd477007f0 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action" status: 200 len: 28430 microversion: 2.1 time: 0.500056 Dec 14 03:17:09.912507 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 180/335] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:17:09 2021] POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action => generated 28430 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 14 03:17:09.917734 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-96c569fc-57b0-44e9-9336-017f8e665474 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:17:09.918649 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-96c569fc-57b0-44e9-9336-017f8e665474 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] [instance: cfd2456c-8f28-4be0-9c97-8e03b0fec041] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:09.926249 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-96c569fc-57b0-44e9-9336-017f8e665474 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:09.926784 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-96c569fc-57b0-44e9-9336-017f8e665474 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:09.927729 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-96c569fc-57b0-44e9-9336-017f8e665474 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:09.928247 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-96c569fc-57b0-44e9-9336-017f8e665474 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:09.949619 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-1111661f-a792-412d-991f-73132ddb721f tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action" status: 200 len: 29219 microversion: 2.20 time: 0.583469 Dec 14 03:17:09.950677 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 156/336] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:17:09 2021] POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action => generated 29219 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:17:09.958336 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-54e718d0-b642-46d1-be07-5b24633a87f2 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:17:09.959067 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-54e718d0-b642-46d1-be07-5b24633a87f2 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:09.969206 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-54e718d0-b642-46d1-be07-5b24633a87f2 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:09.969867 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-54e718d0-b642-46d1-be07-5b24633a87f2 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:09.970653 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-54e718d0-b642-46d1-be07-5b24633a87f2 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:09.971125 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-54e718d0-b642-46d1-be07-5b24633a87f2 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:10.338526 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-96c569fc-57b0-44e9-9336-017f8e665474 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d620fa9da54f588f753b3c497f00c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:17:10.346462 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-96c569fc-57b0-44e9-9336-017f8e665474 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041" status: 200 len: 1359 microversion: 2.1 time: 0.432484 Dec 14 03:17:10.347076 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 181/337] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:17:09 2021] GET /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041 => generated 1359 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:17:10.358835 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-676f2a29-8f04-48fb-933d-9219143e47be tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:17:10.359498 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-676f2a29-8f04-48fb-933d-9219143e47be tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: 4687b559-c95a-4b82-a076-a7468c10ebef] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:10.372496 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-676f2a29-8f04-48fb-933d-9219143e47be tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:10.372943 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-676f2a29-8f04-48fb-933d-9219143e47be tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:10.373740 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-676f2a29-8f04-48fb-933d-9219143e47be tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:10.374171 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-676f2a29-8f04-48fb-933d-9219143e47be tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:10.492176 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-54e718d0-b642-46d1-be07-5b24633a87f2 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:17:10.502476 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-54e718d0-b642-46d1-be07-5b24633a87f2 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe" status: 200 len: 1317 microversion: 2.1 time: 0.549753 Dec 14 03:17:10.513025 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 157/338] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:17:09 2021] GET /compute/v2.1/servers/e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe => generated 1317 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:17:10.788131 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-676f2a29-8f04-48fb-933d-9219143e47be tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:17:10.803564 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-676f2a29-8f04-48fb-933d-9219143e47be tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef" status: 200 len: 1501 microversion: 2.1 time: 0.455047 Dec 14 03:17:10.805407 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 182/339] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:17:10 2021] GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef => generated 1501 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:17:10.821559 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-701d3f88-3fa9-4a63-a990-f6fa5bd0d41f tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5f4c4cb6-ffbc-43eb-abdd-9f1a19967fa6"}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:17:10.823113 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-701d3f88-3fa9-4a63-a990-f6fa5bd0d41f tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: 4687b559-c95a-4b82-a076-a7468c10ebef] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:10.830086 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-701d3f88-3fa9-4a63-a990-f6fa5bd0d41f tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:10.830944 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-701d3f88-3fa9-4a63-a990-f6fa5bd0d41f tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:10.832038 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-701d3f88-3fa9-4a63-a990-f6fa5bd0d41f tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:10.832710 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-701d3f88-3fa9-4a63-a990-f6fa5bd0d41f tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:10.870992 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.wsgi [None req-701d3f88-3fa9-4a63-a990-f6fa5bd0d41f tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] HTTP exception thrown: Cannot 'attach_volume' instance 4687b559-c95a-4b82-a076-a7468c10ebef while it is in vm_state rescued Dec 14 03:17:10.871825 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-701d3f88-3fa9-4a63-a990-f6fa5bd0d41f tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Returning 409 to user: Cannot 'attach_volume' instance 4687b559-c95a-4b82-a076-a7468c10ebef while it is in vm_state rescued {{(pid=116071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 03:17:10.872653 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-701d3f88-3fa9-4a63-a990-f6fa5bd0d41f tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "POST /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.055008 Dec 14 03:17:10.873439 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 158/340] 10.222.0.43 () {60 vars in 1322 bytes} [Tue Dec 14 03:17:10 2021] POST /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef/os-volume_attachments => generated 152 bytes in 56 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Dec 14 03:17:10.882597 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-e6514dee-6ad5-4976-9373-2743ff5d7024 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:17:10.883173 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-e6514dee-6ad5-4976-9373-2743ff5d7024 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: 4687b559-c95a-4b82-a076-a7468c10ebef] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:10.903142 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e6514dee-6ad5-4976-9373-2743ff5d7024 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:10.904106 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e6514dee-6ad5-4976-9373-2743ff5d7024 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:10.905196 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e6514dee-6ad5-4976-9373-2743ff5d7024 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:10.906546 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e6514dee-6ad5-4976-9373-2743ff5d7024 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:10.939740 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-d90554f9-8d47-4a1f-90c7-0eb58a0e5600 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:17:10.941121 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-d90554f9-8d47-4a1f-90c7-0eb58a0e5600 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:10.954983 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-d90554f9-8d47-4a1f-90c7-0eb58a0e5600 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:10.956347 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-d90554f9-8d47-4a1f-90c7-0eb58a0e5600 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:10.957491 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-d90554f9-8d47-4a1f-90c7-0eb58a0e5600 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:10.958115 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-d90554f9-8d47-4a1f-90c7-0eb58a0e5600 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:11.031424 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-e6514dee-6ad5-4976-9373-2743ff5d7024 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "POST /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef/action" status: 202 len: 0 microversion: 2.1 time: 0.152273 Dec 14 03:17:11.036708 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 183/341] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:17:10 2021] POST /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef/action => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:17:11.042679 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-69a000cc-e632-4f3a-82c9-002c2e5671ab tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:17:11.044141 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-69a000cc-e632-4f3a-82c9-002c2e5671ab tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:11.051407 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-69a000cc-e632-4f3a-82c9-002c2e5671ab tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:11.052662 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-69a000cc-e632-4f3a-82c9-002c2e5671ab tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:11.053732 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-69a000cc-e632-4f3a-82c9-002c2e5671ab tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:11.054552 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-69a000cc-e632-4f3a-82c9-002c2e5671ab tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:29.897893 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-69a000cc-e632-4f3a-82c9-002c2e5671ab tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action" status: 200 len: 29261 microversion: 2.20 time: 18.859340 Dec 14 03:17:29.898613 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 184/342] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:17:11 2021] POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action => generated 29261 bytes in 18861 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:17:29.903334 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-63c8c3df-ec13-4a10-8b66-aac3cf0bd951 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:17:29.904028 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-63c8c3df-ec13-4a10-8b66-aac3cf0bd951 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: 4687b559-c95a-4b82-a076-a7468c10ebef] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:29.911439 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-63c8c3df-ec13-4a10-8b66-aac3cf0bd951 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:29.911899 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-63c8c3df-ec13-4a10-8b66-aac3cf0bd951 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:29.912751 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-63c8c3df-ec13-4a10-8b66-aac3cf0bd951 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:29.913184 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-63c8c3df-ec13-4a10-8b66-aac3cf0bd951 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:29.941428 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-d90554f9-8d47-4a1f-90c7-0eb58a0e5600 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action" status: 200 len: 28598 microversion: 2.1 time: 19.006533 Dec 14 03:17:29.942231 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 159/343] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:17:10 2021] POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action => generated 28598 bytes in 19010 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:17:29.947301 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [req-9b512709-3c3d-4643-9a18-68c45d013fe9 req-022bb6f7-d69f-4bd3-92e2-6220a3b2ada3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfd2456c-8f28-4be0-9c97-8e03b0fec041", "tag": "bb3c28d2-c03d-4924-8dd8-da975e5427e4"}]} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:17:29.948760 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:17:29.948760 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: warnings.warn(msg) Dec 14 03:17:29.958518 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [req-9b512709-3c3d-4643-9a18-68c45d013fe9 req-022bb6f7-d69f-4bd3-92e2-6220a3b2ada3 service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:29.958961 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [req-9b512709-3c3d-4643-9a18-68c45d013fe9 req-022bb6f7-d69f-4bd3-92e2-6220a3b2ada3 service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:29.970312 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.compute.server_external_events [req-9b512709-3c3d-4643-9a18-68c45d013fe9 req-022bb6f7-d69f-4bd3-92e2-6220a3b2ada3 service nova] Creating event network-changed:bb3c28d2-c03d-4924-8dd8-da975e5427e4 for instance cfd2456c-8f28-4be0-9c97-8e03b0fec041 on hv-cinder-81803 Dec 14 03:17:29.975088 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [req-9b512709-3c3d-4643-9a18-68c45d013fe9 req-022bb6f7-d69f-4bd3-92e2-6220a3b2ada3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031481 Dec 14 03:17:29.975853 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 160/344] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Dec 14 03:17:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:17:29.980843 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-4c07125d-9528-4779-b33b-e47834f2e226 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:17:29.981523 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-4c07125d-9528-4779-b33b-e47834f2e226 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] [instance: cfd2456c-8f28-4be0-9c97-8e03b0fec041] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:29.989189 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-4c07125d-9528-4779-b33b-e47834f2e226 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:29.989647 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-4c07125d-9528-4779-b33b-e47834f2e226 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:29.990483 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-4c07125d-9528-4779-b33b-e47834f2e226 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:29.990931 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-4c07125d-9528-4779-b33b-e47834f2e226 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:30.216229 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-63c8c3df-ec13-4a10-8b66-aac3cf0bd951 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:17:30.226206 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-63c8c3df-ec13-4a10-8b66-aac3cf0bd951 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef" status: 200 len: 1509 microversion: 2.1 time: 0.326453 Dec 14 03:17:30.233502 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 185/345] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:17:29 2021] GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef => generated 1509 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:17:30.238945 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-e719823f-7a3f-4fb9-8877-492127d70fc6 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:17:30.239581 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-e719823f-7a3f-4fb9-8877-492127d70fc6 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:30.245810 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e719823f-7a3f-4fb9-8877-492127d70fc6 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:30.246341 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e719823f-7a3f-4fb9-8877-492127d70fc6 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:30.247032 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e719823f-7a3f-4fb9-8877-492127d70fc6 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:30.247883 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e719823f-7a3f-4fb9-8877-492127d70fc6 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:30.261217 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-4c07125d-9528-4779-b33b-e47834f2e226 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d620fa9da54f588f753b3c497f00c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:17:30.270757 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-4c07125d-9528-4779-b33b-e47834f2e226 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041" status: 200 len: 1359 microversion: 2.1 time: 0.293812 Dec 14 03:17:30.283118 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 161/346] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:17:29 2021] GET /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041 => generated 1359 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:17:30.381871 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-e719823f-7a3f-4fb9-8877-492127d70fc6 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:17:30.388948 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-e719823f-7a3f-4fb9-8877-492127d70fc6 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe" status: 200 len: 1317 microversion: 2.1 time: 0.153837 Dec 14 03:17:30.389504 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 186/347] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:17:30 2021] GET /compute/v2.1/servers/e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:17:30.910222 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-7b999b84-0eb6-40fa-889f-4bea90c85685 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:17:30.911293 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-7b999b84-0eb6-40fa-889f-4bea90c85685 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:30.917583 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-7b999b84-0eb6-40fa-889f-4bea90c85685 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:30.918041 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-7b999b84-0eb6-40fa-889f-4bea90c85685 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:30.918827 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-7b999b84-0eb6-40fa-889f-4bea90c85685 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:30.919309 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-7b999b84-0eb6-40fa-889f-4bea90c85685 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:30.953192 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-cab8487f-113a-4234-aa75-3b25046de47f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:17:30.954158 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-cab8487f-113a-4234-aa75-3b25046de47f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:30.960424 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-cab8487f-113a-4234-aa75-3b25046de47f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:30.960875 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-cab8487f-113a-4234-aa75-3b25046de47f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:30.961639 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-cab8487f-113a-4234-aa75-3b25046de47f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:30.962070 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-cab8487f-113a-4234-aa75-3b25046de47f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:34.625485 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-7b999b84-0eb6-40fa-889f-4bea90c85685 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action" status: 200 len: 29261 microversion: 2.20 time: 3.719249 Dec 14 03:17:34.630189 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 162/348] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:17:30 2021] POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action => generated 29261 bytes in 3722 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:17:34.632468 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-95a45706-9edb-4b4f-8b80-57e319201afe tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:17:34.633163 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-95a45706-9edb-4b4f-8b80-57e319201afe tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: 4687b559-c95a-4b82-a076-a7468c10ebef] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:34.640389 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-95a45706-9edb-4b4f-8b80-57e319201afe tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:34.641203 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-95a45706-9edb-4b4f-8b80-57e319201afe tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:34.641620 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-95a45706-9edb-4b4f-8b80-57e319201afe tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:34.642054 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-95a45706-9edb-4b4f-8b80-57e319201afe tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:34.678660 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-cab8487f-113a-4234-aa75-3b25046de47f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action" status: 200 len: 28598 microversion: 2.1 time: 3.728909 Dec 14 03:17:34.683297 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 187/349] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:17:30 2021] POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action => generated 28598 bytes in 3731 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 14 03:17:34.684851 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-04656a72-1e03-4d2c-8ef3-1c1a0aca6b60 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:17:34.685541 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-04656a72-1e03-4d2c-8ef3-1c1a0aca6b60 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] [instance: cfd2456c-8f28-4be0-9c97-8e03b0fec041] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:34.694010 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-04656a72-1e03-4d2c-8ef3-1c1a0aca6b60 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:34.694908 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-04656a72-1e03-4d2c-8ef3-1c1a0aca6b60 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:34.695739 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-04656a72-1e03-4d2c-8ef3-1c1a0aca6b60 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:34.696175 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-04656a72-1e03-4d2c-8ef3-1c1a0aca6b60 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:35.094236 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-95a45706-9edb-4b4f-8b80-57e319201afe tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:17:35.101466 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-95a45706-9edb-4b4f-8b80-57e319201afe tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef" status: 200 len: 1509 microversion: 2.1 time: 0.472638 Dec 14 03:17:35.102447 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 163/350] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:17:34 2021] GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef => generated 1509 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:17:35.106214 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-8186321e-c2d4-4d95-83d5-76743183e547 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:17:35.106827 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-8186321e-c2d4-4d95-83d5-76743183e547 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:35.114765 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-8186321e-c2d4-4d95-83d5-76743183e547 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:35.115250 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-8186321e-c2d4-4d95-83d5-76743183e547 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:35.116042 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-8186321e-c2d4-4d95-83d5-76743183e547 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:35.116479 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-8186321e-c2d4-4d95-83d5-76743183e547 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:35.124099 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-04656a72-1e03-4d2c-8ef3-1c1a0aca6b60 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d620fa9da54f588f753b3c497f00c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:17:35.132547 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-04656a72-1e03-4d2c-8ef3-1c1a0aca6b60 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041" status: 200 len: 1359 microversion: 2.1 time: 0.451308 Dec 14 03:17:35.133355 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 188/351] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:17:34 2021] GET /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041 => generated 1359 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:17:35.321842 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-8186321e-c2d4-4d95-83d5-76743183e547 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:17:35.329142 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-8186321e-c2d4-4d95-83d5-76743183e547 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe" status: 200 len: 1317 microversion: 2.1 time: 0.226150 Dec 14 03:17:35.329715 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 164/352] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:17:35 2021] GET /compute/v2.1/servers/e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe => generated 1317 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:17:35.637899 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-cc3f3441-6aaa-46a1-acc6-f8999ec264b9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:17:35.638820 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-cc3f3441-6aaa-46a1-acc6-f8999ec264b9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:35.646335 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-cc3f3441-6aaa-46a1-acc6-f8999ec264b9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:35.646783 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-cc3f3441-6aaa-46a1-acc6-f8999ec264b9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:35.647639 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-cc3f3441-6aaa-46a1-acc6-f8999ec264b9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:35.648070 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-cc3f3441-6aaa-46a1-acc6-f8999ec264b9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:35.691605 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-49584fde-5e6f-4ccc-a140-2051beb68470 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:17:35.693354 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-49584fde-5e6f-4ccc-a140-2051beb68470 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:35.700821 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-49584fde-5e6f-4ccc-a140-2051beb68470 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:35.701520 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-49584fde-5e6f-4ccc-a140-2051beb68470 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:35.702438 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-49584fde-5e6f-4ccc-a140-2051beb68470 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:35.702874 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-49584fde-5e6f-4ccc-a140-2051beb68470 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:35.786301 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-cc3f3441-6aaa-46a1-acc6-f8999ec264b9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action" status: 200 len: 29261 microversion: 2.20 time: 0.152144 Dec 14 03:17:35.786982 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 189/353] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:17:35 2021] POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action => generated 29261 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:17:36.120709 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-6b509ee7-8914-4fa4-be1e-5e701699fc33 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:17:36.121409 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-6b509ee7-8914-4fa4-be1e-5e701699fc33 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: 4687b559-c95a-4b82-a076-a7468c10ebef] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:36.128329 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6b509ee7-8914-4fa4-be1e-5e701699fc33 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:36.128782 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6b509ee7-8914-4fa4-be1e-5e701699fc33 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:36.129569 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6b509ee7-8914-4fa4-be1e-5e701699fc33 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:36.129996 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6b509ee7-8914-4fa4-be1e-5e701699fc33 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:36.265182 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-6b509ee7-8914-4fa4-be1e-5e701699fc33 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:17:36.273034 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-6b509ee7-8914-4fa4-be1e-5e701699fc33 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef" status: 200 len: 1509 microversion: 2.1 time: 0.156421 Dec 14 03:17:36.273601 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 190/354] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:17:36 2021] GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef => generated 1509 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 03:17:36.277722 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-88cc76cb-1279-469a-9ca1-5d191391d380 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:17:36.278331 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-88cc76cb-1279-469a-9ca1-5d191391d380 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] [instance: cfd2456c-8f28-4be0-9c97-8e03b0fec041] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:36.284902 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-88cc76cb-1279-469a-9ca1-5d191391d380 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:36.285357 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-88cc76cb-1279-469a-9ca1-5d191391d380 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:36.286147 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-88cc76cb-1279-469a-9ca1-5d191391d380 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:36.286589 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-88cc76cb-1279-469a-9ca1-5d191391d380 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:36.321874 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-49584fde-5e6f-4ccc-a140-2051beb68470 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action" status: 200 len: 28598 microversion: 2.1 time: 0.634507 Dec 14 03:17:36.322949 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 165/355] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:17:35 2021] POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action => generated 28598 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 14 03:17:36.346544 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-a89f9efb-efbb-4b6e-a4be-0d0ff9f399d3 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:17:36.347313 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-a89f9efb-efbb-4b6e-a4be-0d0ff9f399d3 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:36.354124 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a89f9efb-efbb-4b6e-a4be-0d0ff9f399d3 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:36.354586 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a89f9efb-efbb-4b6e-a4be-0d0ff9f399d3 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:36.355410 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a89f9efb-efbb-4b6e-a4be-0d0ff9f399d3 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:36.355854 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a89f9efb-efbb-4b6e-a4be-0d0ff9f399d3 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:36.460800 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-88cc76cb-1279-469a-9ca1-5d191391d380 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d620fa9da54f588f753b3c497f00c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:17:36.468335 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-88cc76cb-1279-469a-9ca1-5d191391d380 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041" status: 200 len: 1359 microversion: 2.1 time: 0.193684 Dec 14 03:17:36.468946 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 191/356] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:17:36 2021] GET /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041 => generated 1359 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:17:36.537360 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-a89f9efb-efbb-4b6e-a4be-0d0ff9f399d3 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:17:36.545980 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-a89f9efb-efbb-4b6e-a4be-0d0ff9f399d3 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe" status: 200 len: 1317 microversion: 2.1 time: 0.203848 Dec 14 03:17:36.555773 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 166/357] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:17:36 2021] GET /compute/v2.1/servers/e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe => generated 1317 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 03:17:36.797656 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-124dec50-5e74-4e6f-9833-4020cfdf3cc4 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:17:36.798641 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-124dec50-5e74-4e6f-9833-4020cfdf3cc4 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:36.805674 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-124dec50-5e74-4e6f-9833-4020cfdf3cc4 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:36.806343 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-124dec50-5e74-4e6f-9833-4020cfdf3cc4 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:36.807163 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-124dec50-5e74-4e6f-9833-4020cfdf3cc4 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:36.807605 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-124dec50-5e74-4e6f-9833-4020cfdf3cc4 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:37.055263 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-124dec50-5e74-4e6f-9833-4020cfdf3cc4 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action" status: 200 len: 29261 microversion: 2.20 time: 0.260813 Dec 14 03:17:37.055842 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 192/358] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:17:36 2021] POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action => generated 29261 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:17:37.289604 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-cca6079b-ec0c-49a9-b652-5ac820042c15 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:17:37.290217 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-cca6079b-ec0c-49a9-b652-5ac820042c15 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: 4687b559-c95a-4b82-a076-a7468c10ebef] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:37.296779 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-cca6079b-ec0c-49a9-b652-5ac820042c15 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:37.297351 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-cca6079b-ec0c-49a9-b652-5ac820042c15 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:37.298130 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-cca6079b-ec0c-49a9-b652-5ac820042c15 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:37.298566 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-cca6079b-ec0c-49a9-b652-5ac820042c15 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:37.334232 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-e07ebac0-da19-49c6-b84c-7b8f535a4bcf tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:17:37.335262 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-e07ebac0-da19-49c6-b84c-7b8f535a4bcf tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:37.342553 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e07ebac0-da19-49c6-b84c-7b8f535a4bcf tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:37.342984 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e07ebac0-da19-49c6-b84c-7b8f535a4bcf tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:37.346351 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e07ebac0-da19-49c6-b84c-7b8f535a4bcf tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:37.346824 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e07ebac0-da19-49c6-b84c-7b8f535a4bcf tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:37.431786 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-cca6079b-ec0c-49a9-b652-5ac820042c15 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:17:37.439067 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-cca6079b-ec0c-49a9-b652-5ac820042c15 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef" status: 200 len: 1509 microversion: 2.1 time: 0.153107 Dec 14 03:17:37.439639 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 167/359] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:17:37 2021] GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef => generated 1509 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:17:37.485260 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-862d8f3f-b2ca-45e8-8fba-fb39f4d0430d tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:17:37.485868 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-862d8f3f-b2ca-45e8-8fba-fb39f4d0430d tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] [instance: cfd2456c-8f28-4be0-9c97-8e03b0fec041] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:37.492296 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-862d8f3f-b2ca-45e8-8fba-fb39f4d0430d tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:37.492742 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-862d8f3f-b2ca-45e8-8fba-fb39f4d0430d tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:37.493511 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-862d8f3f-b2ca-45e8-8fba-fb39f4d0430d tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:37.493944 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-862d8f3f-b2ca-45e8-8fba-fb39f4d0430d tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:37.505163 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-e07ebac0-da19-49c6-b84c-7b8f535a4bcf tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action" status: 200 len: 28598 microversion: 2.1 time: 0.174873 Dec 14 03:17:37.508556 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 193/360] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:17:37 2021] POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action => generated 28598 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 14 03:17:37.563882 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-00acb5b2-d164-46de-a3d9-2f1ede2408c8 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:17:37.564657 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-00acb5b2-d164-46de-a3d9-2f1ede2408c8 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:37.571768 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-00acb5b2-d164-46de-a3d9-2f1ede2408c8 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:37.572312 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-00acb5b2-d164-46de-a3d9-2f1ede2408c8 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:37.573283 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-00acb5b2-d164-46de-a3d9-2f1ede2408c8 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:37.573777 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-00acb5b2-d164-46de-a3d9-2f1ede2408c8 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:37.652163 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-862d8f3f-b2ca-45e8-8fba-fb39f4d0430d tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d620fa9da54f588f753b3c497f00c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:17:37.664761 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-862d8f3f-b2ca-45e8-8fba-fb39f4d0430d tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041" status: 200 len: 1359 microversion: 2.1 time: 0.182714 Dec 14 03:17:37.665349 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 168/361] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:17:37 2021] GET /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041 => generated 1359 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 03:17:37.725575 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-00acb5b2-d164-46de-a3d9-2f1ede2408c8 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:17:37.733526 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-00acb5b2-d164-46de-a3d9-2f1ede2408c8 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe" status: 200 len: 1317 microversion: 2.1 time: 0.173446 Dec 14 03:17:37.734082 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 194/362] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:17:37 2021] GET /compute/v2.1/servers/e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe => generated 1317 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 03:17:38.067620 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-3e5f84db-5c87-400b-a6b0-0af70b693307 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:17:38.068618 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-3e5f84db-5c87-400b-a6b0-0af70b693307 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:38.079808 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-3e5f84db-5c87-400b-a6b0-0af70b693307 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:38.080265 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-3e5f84db-5c87-400b-a6b0-0af70b693307 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:38.081075 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-3e5f84db-5c87-400b-a6b0-0af70b693307 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:38.081531 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-3e5f84db-5c87-400b-a6b0-0af70b693307 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:38.221702 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-3e5f84db-5c87-400b-a6b0-0af70b693307 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action" status: 200 len: 29261 microversion: 2.20 time: 0.157603 Dec 14 03:17:38.222504 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 169/363] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:17:38 2021] POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action => generated 29261 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:17:38.456597 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-33908ca5-d6b3-4ac8-8d9e-0192ce1b0354 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:17:38.457309 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-33908ca5-d6b3-4ac8-8d9e-0192ce1b0354 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: 4687b559-c95a-4b82-a076-a7468c10ebef] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:38.466652 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-33908ca5-d6b3-4ac8-8d9e-0192ce1b0354 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:38.467183 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-33908ca5-d6b3-4ac8-8d9e-0192ce1b0354 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:38.468100 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-33908ca5-d6b3-4ac8-8d9e-0192ce1b0354 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:38.468535 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-33908ca5-d6b3-4ac8-8d9e-0192ce1b0354 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:38.516528 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-ffee7d7f-e1ca-4284-bb68-d5937aab5b9d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:17:38.518932 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-ffee7d7f-e1ca-4284-bb68-d5937aab5b9d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:38.526706 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ffee7d7f-e1ca-4284-bb68-d5937aab5b9d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:38.527189 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ffee7d7f-e1ca-4284-bb68-d5937aab5b9d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:38.528255 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ffee7d7f-e1ca-4284-bb68-d5937aab5b9d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:38.528775 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ffee7d7f-e1ca-4284-bb68-d5937aab5b9d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:38.612914 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-33908ca5-d6b3-4ac8-8d9e-0192ce1b0354 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:17:38.620351 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-33908ca5-d6b3-4ac8-8d9e-0192ce1b0354 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef" status: 200 len: 1509 microversion: 2.1 time: 0.168450 Dec 14 03:17:38.620905 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 195/364] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:17:38 2021] GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef => generated 1509 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:17:38.637869 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-ffee7d7f-e1ca-4284-bb68-d5937aab5b9d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action" status: 200 len: 28598 microversion: 2.1 time: 0.125450 Dec 14 03:17:38.638506 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 170/365] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:17:38 2021] POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action => generated 28598 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:17:38.681845 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-7396d73f-2157-4cab-bf22-b360d8ea5a7e tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:17:38.682493 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-7396d73f-2157-4cab-bf22-b360d8ea5a7e tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] [instance: cfd2456c-8f28-4be0-9c97-8e03b0fec041] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:38.688375 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7396d73f-2157-4cab-bf22-b360d8ea5a7e tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:38.688829 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7396d73f-2157-4cab-bf22-b360d8ea5a7e tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:38.690165 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7396d73f-2157-4cab-bf22-b360d8ea5a7e tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:38.690604 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7396d73f-2157-4cab-bf22-b360d8ea5a7e tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:38.750759 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-72800299-8e89-4e46-8f9b-7127dd27d8d7 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:17:38.751491 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-72800299-8e89-4e46-8f9b-7127dd27d8d7 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:38.758431 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-72800299-8e89-4e46-8f9b-7127dd27d8d7 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:38.758826 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-72800299-8e89-4e46-8f9b-7127dd27d8d7 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:38.759642 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-72800299-8e89-4e46-8f9b-7127dd27d8d7 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:38.760086 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-72800299-8e89-4e46-8f9b-7127dd27d8d7 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:38.846350 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-7396d73f-2157-4cab-bf22-b360d8ea5a7e tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d620fa9da54f588f753b3c497f00c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:17:38.853762 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-7396d73f-2157-4cab-bf22-b360d8ea5a7e tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041" status: 200 len: 1359 microversion: 2.1 time: 0.175496 Dec 14 03:17:38.854337 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 196/366] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:17:38 2021] GET /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041 => generated 1359 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:17:38.921165 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-72800299-8e89-4e46-8f9b-7127dd27d8d7 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:17:38.929009 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-72800299-8e89-4e46-8f9b-7127dd27d8d7 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe" status: 200 len: 1317 microversion: 2.1 time: 0.182195 Dec 14 03:17:38.929593 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 171/367] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:17:38 2021] GET /compute/v2.1/servers/e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe => generated 1317 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 03:17:39.233383 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-dd68c808-2952-42d8-9a5e-17ea4aaa92ba tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:17:39.234397 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-dd68c808-2952-42d8-9a5e-17ea4aaa92ba tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:39.240811 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-dd68c808-2952-42d8-9a5e-17ea4aaa92ba tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:39.241255 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-dd68c808-2952-42d8-9a5e-17ea4aaa92ba tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:39.242033 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-dd68c808-2952-42d8-9a5e-17ea4aaa92ba tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:39.242467 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-dd68c808-2952-42d8-9a5e-17ea4aaa92ba tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:39.454226 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-dd68c808-2952-42d8-9a5e-17ea4aaa92ba tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action" status: 200 len: 29261 microversion: 2.20 time: 0.224138 Dec 14 03:17:39.458028 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 197/368] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:17:39 2021] POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action => generated 29261 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:17:39.637476 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-c894b3e7-5b6d-4d45-862d-586fe35f36e0 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:17:39.638119 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-c894b3e7-5b6d-4d45-862d-586fe35f36e0 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: 4687b559-c95a-4b82-a076-a7468c10ebef] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:39.644367 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c894b3e7-5b6d-4d45-862d-586fe35f36e0 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:39.644816 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c894b3e7-5b6d-4d45-862d-586fe35f36e0 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:39.645587 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c894b3e7-5b6d-4d45-862d-586fe35f36e0 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:39.646026 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c894b3e7-5b6d-4d45-862d-586fe35f36e0 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:39.684927 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-34a301be-9e4c-4e62-b9c7-eadc63a0b815 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:17:39.686052 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-34a301be-9e4c-4e62-b9c7-eadc63a0b815 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:39.692961 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-34a301be-9e4c-4e62-b9c7-eadc63a0b815 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:39.693411 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-34a301be-9e4c-4e62-b9c7-eadc63a0b815 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:39.694198 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-34a301be-9e4c-4e62-b9c7-eadc63a0b815 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:39.694637 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-34a301be-9e4c-4e62-b9c7-eadc63a0b815 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:39.775249 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-c894b3e7-5b6d-4d45-862d-586fe35f36e0 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:17:39.782336 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-c894b3e7-5b6d-4d45-862d-586fe35f36e0 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef" status: 200 len: 1515 microversion: 2.1 time: 0.148570 Dec 14 03:17:39.782884 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 172/369] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:17:39 2021] GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef => generated 1515 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:17:39.803417 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-34a301be-9e4c-4e62-b9c7-eadc63a0b815 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action" status: 200 len: 28598 microversion: 2.1 time: 0.122201 Dec 14 03:17:39.807197 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 198/370] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:17:39 2021] POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action => generated 28598 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 14 03:17:39.876400 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-792818dd-6ea8-4c53-a06b-32762705d922 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:17:39.877018 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-792818dd-6ea8-4c53-a06b-32762705d922 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] [instance: cfd2456c-8f28-4be0-9c97-8e03b0fec041] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:39.883323 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-792818dd-6ea8-4c53-a06b-32762705d922 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:39.883807 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-792818dd-6ea8-4c53-a06b-32762705d922 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:39.884596 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-792818dd-6ea8-4c53-a06b-32762705d922 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:39.885036 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-792818dd-6ea8-4c53-a06b-32762705d922 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:39.946428 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-8dd07e1f-581e-4909-b675-7fafb85d3841 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:17:39.947151 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-8dd07e1f-581e-4909-b675-7fafb85d3841 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:39.954034 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8dd07e1f-581e-4909-b675-7fafb85d3841 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:39.954483 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8dd07e1f-581e-4909-b675-7fafb85d3841 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:39.955340 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8dd07e1f-581e-4909-b675-7fafb85d3841 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:39.955938 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8dd07e1f-581e-4909-b675-7fafb85d3841 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:40.055464 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-792818dd-6ea8-4c53-a06b-32762705d922 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d620fa9da54f588f753b3c497f00c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:17:40.068199 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-792818dd-6ea8-4c53-a06b-32762705d922 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041" status: 200 len: 1359 microversion: 2.1 time: 0.195836 Dec 14 03:17:40.068869 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 173/371] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:17:39 2021] GET /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041 => generated 1359 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:17:40.129987 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-8dd07e1f-581e-4909-b675-7fafb85d3841 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:17:40.137341 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-8dd07e1f-581e-4909-b675-7fafb85d3841 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe" status: 200 len: 1317 microversion: 2.1 time: 0.195140 Dec 14 03:17:40.137892 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 199/372] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:17:39 2021] GET /compute/v2.1/servers/e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe => generated 1317 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 03:17:40.466371 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-fcb3d83c-76cb-430a-900b-a410c68af23b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:17:40.467399 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-fcb3d83c-76cb-430a-900b-a410c68af23b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:40.474014 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-fcb3d83c-76cb-430a-900b-a410c68af23b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:40.474571 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-fcb3d83c-76cb-430a-900b-a410c68af23b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:40.475418 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-fcb3d83c-76cb-430a-900b-a410c68af23b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:40.475863 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-fcb3d83c-76cb-430a-900b-a410c68af23b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:40.582370 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-fcb3d83c-76cb-430a-900b-a410c68af23b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action" status: 200 len: 29261 microversion: 2.20 time: 0.120014 Dec 14 03:17:40.586231 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 174/373] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:17:40 2021] POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action => generated 29261 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:17:40.815659 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-ebc0ff72-d071-4936-af2d-fcd96f03906b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:17:40.816739 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-ebc0ff72-d071-4936-af2d-fcd96f03906b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:40.824108 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ebc0ff72-d071-4936-af2d-fcd96f03906b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:40.824630 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ebc0ff72-d071-4936-af2d-fcd96f03906b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:40.825495 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ebc0ff72-d071-4936-af2d-fcd96f03906b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:40.826013 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ebc0ff72-d071-4936-af2d-fcd96f03906b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:40.921108 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-ebc0ff72-d071-4936-af2d-fcd96f03906b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action" status: 200 len: 28598 microversion: 2.1 time: 0.110003 Dec 14 03:17:40.921968 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 200/374] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:17:40 2021] POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action => generated 28598 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:17:41.086095 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-de723c22-0f58-444b-b595-0782b84eb015 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:17:41.086805 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-de723c22-0f58-444b-b595-0782b84eb015 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] [instance: cfd2456c-8f28-4be0-9c97-8e03b0fec041] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:41.093254 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-de723c22-0f58-444b-b595-0782b84eb015 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:41.093970 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-de723c22-0f58-444b-b595-0782b84eb015 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:41.095155 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-de723c22-0f58-444b-b595-0782b84eb015 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:41.099362 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-de723c22-0f58-444b-b595-0782b84eb015 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:41.124389 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-f1152eb4-ca4f-4b3e-a059-cde60c3a845f tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:17:41.125128 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-f1152eb4-ca4f-4b3e-a059-cde60c3a845f tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: 4687b559-c95a-4b82-a076-a7468c10ebef] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:41.132719 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f1152eb4-ca4f-4b3e-a059-cde60c3a845f tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:41.133437 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f1152eb4-ca4f-4b3e-a059-cde60c3a845f tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:41.134400 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f1152eb4-ca4f-4b3e-a059-cde60c3a845f tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:41.135007 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f1152eb4-ca4f-4b3e-a059-cde60c3a845f tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:41.332984 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-de723c22-0f58-444b-b595-0782b84eb015 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d620fa9da54f588f753b3c497f00c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:17:41.333131 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-f1152eb4-ca4f-4b3e-a059-cde60c3a845f tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:17:41.340576 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-f1152eb4-ca4f-4b3e-a059-cde60c3a845f tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef" status: 200 len: 1515 microversion: 2.1 time: 0.221464 Dec 14 03:17:41.341132 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 201/375] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:17:41 2021] GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef => generated 1515 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 03:17:41.347674 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-de723c22-0f58-444b-b595-0782b84eb015 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041" status: 200 len: 1359 microversion: 2.1 time: 0.265904 Dec 14 03:17:41.348603 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 175/376] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:17:41 2021] GET /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041 => generated 1359 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:17:41.350812 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-9435e8df-6b06-459a-a803-2ee51e998f5e tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:17:41.351474 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-9435e8df-6b06-459a-a803-2ee51e998f5e tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:41.359606 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-7a989735-a6fb-462b-a454-20ba69cf02de tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8fc257ab-fecc-4e38-a295-cd87cd187bdc"}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:17:41.362647 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-7a989735-a6fb-462b-a454-20ba69cf02de tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: 4687b559-c95a-4b82-a076-a7468c10ebef] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:41.365015 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9435e8df-6b06-459a-a803-2ee51e998f5e tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:41.365467 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9435e8df-6b06-459a-a803-2ee51e998f5e tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:41.366253 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9435e8df-6b06-459a-a803-2ee51e998f5e tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:41.366684 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9435e8df-6b06-459a-a803-2ee51e998f5e tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:41.372543 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-7a989735-a6fb-462b-a454-20ba69cf02de tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:41.373181 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-7a989735-a6fb-462b-a454-20ba69cf02de tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:41.374138 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-7a989735-a6fb-462b-a454-20ba69cf02de tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:41.374805 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-7a989735-a6fb-462b-a454-20ba69cf02de tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:41.524099 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-9435e8df-6b06-459a-a803-2ee51e998f5e tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:17:41.531756 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-9435e8df-6b06-459a-a803-2ee51e998f5e tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe" status: 200 len: 1317 microversion: 2.1 time: 0.189474 Dec 14 03:17:41.532569 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 202/377] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:17:41 2021] GET /compute/v2.1/servers/e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe => generated 1317 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:17:41.537047 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [req-4c2e4c50-83b7-4a86-830d-40c7a59c90b0 req-202be2a7-7cfe-413f-829c-336f43f75bf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe", "name": "network-vif-plugged", "status": "completed", "tag": "9ffbafb8-f71a-4067-8988-a284fbb41603"}]} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:17:41.538729 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:17:41.538729 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: warnings.warn(msg) Dec 14 03:17:41.545794 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-4c2e4c50-83b7-4a86-830d-40c7a59c90b0 req-202be2a7-7cfe-413f-829c-336f43f75bf2 service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:41.546231 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-4c2e4c50-83b7-4a86-830d-40c7a59c90b0 req-202be2a7-7cfe-413f-829c-336f43f75bf2 service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:41.558458 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.compute.server_external_events [req-4c2e4c50-83b7-4a86-830d-40c7a59c90b0 req-202be2a7-7cfe-413f-829c-336f43f75bf2 service nova] Creating event network-vif-plugged:9ffbafb8-f71a-4067-8988-a284fbb41603 for instance e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe on hv-cinder-81803 Dec 14 03:17:41.563324 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [req-4c2e4c50-83b7-4a86-830d-40c7a59c90b0 req-202be2a7-7cfe-413f-829c-336f43f75bf2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029391 Dec 14 03:17:41.564152 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 203/378] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Dec 14 03:17:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:17:41.637208 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-2f2452c8-65fc-491f-9a5c-32301161c96c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:17:41.639198 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-2f2452c8-65fc-491f-9a5c-32301161c96c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:41.645589 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2f2452c8-65fc-491f-9a5c-32301161c96c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:41.646129 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2f2452c8-65fc-491f-9a5c-32301161c96c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:41.646992 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2f2452c8-65fc-491f-9a5c-32301161c96c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:41.647593 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2f2452c8-65fc-491f-9a5c-32301161c96c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:41.751347 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-7a989735-a6fb-462b-a454-20ba69cf02de tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "POST /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.396798 Dec 14 03:17:41.753125 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 176/379] 10.222.0.43 () {60 vars in 1322 bytes} [Tue Dec 14 03:17:41 2021] POST /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef/os-volume_attachments => generated 194 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:17:41.837813 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-2f2452c8-65fc-491f-9a5c-32301161c96c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action" status: 200 len: 29261 microversion: 2.20 time: 0.209043 Dec 14 03:17:41.839601 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 204/380] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:17:41 2021] POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action => generated 29261 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 14 03:17:41.933944 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-35258fb7-66fd-424f-9bba-e56fc798c055 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:17:41.935464 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-35258fb7-66fd-424f-9bba-e56fc798c055 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:41.942577 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-35258fb7-66fd-424f-9bba-e56fc798c055 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:41.943268 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-35258fb7-66fd-424f-9bba-e56fc798c055 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:41.944604 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-35258fb7-66fd-424f-9bba-e56fc798c055 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:41.945060 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-35258fb7-66fd-424f-9bba-e56fc798c055 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:42.370481 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-c0427b81-0434-46b3-8893-66478c7f35a2 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:17:42.371269 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-c0427b81-0434-46b3-8893-66478c7f35a2 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] [instance: cfd2456c-8f28-4be0-9c97-8e03b0fec041] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:42.378281 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c0427b81-0434-46b3-8893-66478c7f35a2 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:42.378728 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c0427b81-0434-46b3-8893-66478c7f35a2 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:42.379534 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c0427b81-0434-46b3-8893-66478c7f35a2 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:42.379995 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c0427b81-0434-46b3-8893-66478c7f35a2 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:42.509449 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-c0427b81-0434-46b3-8893-66478c7f35a2 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d620fa9da54f588f753b3c497f00c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:17:42.513256 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-35258fb7-66fd-424f-9bba-e56fc798c055 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action" status: 200 len: 28598 microversion: 2.1 time: 0.584678 Dec 14 03:17:42.517100 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 177/381] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:17:41 2021] POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action => generated 28598 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 14 03:17:42.517427 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-c0427b81-0434-46b3-8893-66478c7f35a2 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041" status: 200 len: 1359 microversion: 2.1 time: 0.151016 Dec 14 03:17:42.517985 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 205/382] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:17:42 2021] GET /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 03:17:42.549458 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-d9d36a67-92bb-4f67-bd37-f0f5f0aa7da5 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:17:42.550157 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-d9d36a67-92bb-4f67-bd37-f0f5f0aa7da5 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:42.556983 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-d9d36a67-92bb-4f67-bd37-f0f5f0aa7da5 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:42.557433 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-d9d36a67-92bb-4f67-bd37-f0f5f0aa7da5 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:42.558212 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-d9d36a67-92bb-4f67-bd37-f0f5f0aa7da5 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:42.558652 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-d9d36a67-92bb-4f67-bd37-f0f5f0aa7da5 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:42.702560 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-d9d36a67-92bb-4f67-bd37-f0f5f0aa7da5 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:17:42.709768 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-d9d36a67-92bb-4f67-bd37-f0f5f0aa7da5 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe" status: 200 len: 1317 microversion: 2.1 time: 0.164685 Dec 14 03:17:42.710327 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 178/383] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:17:42 2021] GET /compute/v2.1/servers/e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:17:42.849557 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-dcb44f3a-957d-4746-9795-2df14eb5d95a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:17:42.850523 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-dcb44f3a-957d-4746-9795-2df14eb5d95a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:42.856905 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-dcb44f3a-957d-4746-9795-2df14eb5d95a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:42.857342 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-dcb44f3a-957d-4746-9795-2df14eb5d95a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:42.858112 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-dcb44f3a-957d-4746-9795-2df14eb5d95a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:42.858541 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-dcb44f3a-957d-4746-9795-2df14eb5d95a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:43.104206 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-dcb44f3a-957d-4746-9795-2df14eb5d95a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action" status: 200 len: 29261 microversion: 2.20 time: 0.257991 Dec 14 03:17:43.108208 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 206/384] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:17:42 2021] POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action => generated 29261 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 14 03:17:43.525460 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-998284e8-6ff5-447f-9536-6f8e522c64d7 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:17:43.526634 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-998284e8-6ff5-447f-9536-6f8e522c64d7 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:43.536151 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-ecea7811-875f-40f5-9760-29073217eac2 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:17:43.536342 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-998284e8-6ff5-447f-9536-6f8e522c64d7 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:43.536741 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-998284e8-6ff5-447f-9536-6f8e522c64d7 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:43.536851 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-ecea7811-875f-40f5-9760-29073217eac2 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] [instance: cfd2456c-8f28-4be0-9c97-8e03b0fec041] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:43.537616 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-998284e8-6ff5-447f-9536-6f8e522c64d7 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:43.538433 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-998284e8-6ff5-447f-9536-6f8e522c64d7 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:43.542950 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ecea7811-875f-40f5-9760-29073217eac2 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:43.543420 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ecea7811-875f-40f5-9760-29073217eac2 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:43.544224 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ecea7811-875f-40f5-9760-29073217eac2 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:43.544652 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ecea7811-875f-40f5-9760-29073217eac2 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:43.741448 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-ecea7811-875f-40f5-9760-29073217eac2 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d620fa9da54f588f753b3c497f00c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:17:43.748513 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-ecea7811-875f-40f5-9760-29073217eac2 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041" status: 200 len: 1359 microversion: 2.1 time: 0.218049 Dec 14 03:17:43.749060 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 207/385] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:17:43 2021] GET /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041 => generated 1359 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 03:17:43.753934 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-d296f140-fc49-4b18-8c7a-00686ce3f581 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:17:43.754531 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-d296f140-fc49-4b18-8c7a-00686ce3f581 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:43.760093 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d296f140-fc49-4b18-8c7a-00686ce3f581 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:43.760578 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d296f140-fc49-4b18-8c7a-00686ce3f581 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:43.761351 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d296f140-fc49-4b18-8c7a-00686ce3f581 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:43.761811 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d296f140-fc49-4b18-8c7a-00686ce3f581 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:43.792840 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-998284e8-6ff5-447f-9536-6f8e522c64d7 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action" status: 200 len: 28598 microversion: 2.1 time: 0.271501 Dec 14 03:17:43.793691 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 179/386] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:17:43 2021] POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action => generated 28598 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:17:43.924380 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-d296f140-fc49-4b18-8c7a-00686ce3f581 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:17:43.931556 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-d296f140-fc49-4b18-8c7a-00686ce3f581 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe" status: 200 len: 1317 microversion: 2.1 time: 0.181566 Dec 14 03:17:43.932112 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 208/387] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:17:43 2021] GET /compute/v2.1/servers/e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe => generated 1317 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:17:44.126274 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-f674dfa2-e947-4364-bbf6-8fb76a906a06 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:17:44.128266 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-f674dfa2-e947-4364-bbf6-8fb76a906a06 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:44.135174 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-f674dfa2-e947-4364-bbf6-8fb76a906a06 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:44.135621 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-f674dfa2-e947-4364-bbf6-8fb76a906a06 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:44.136419 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-f674dfa2-e947-4364-bbf6-8fb76a906a06 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:44.136858 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-f674dfa2-e947-4364-bbf6-8fb76a906a06 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:44.248288 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-f674dfa2-e947-4364-bbf6-8fb76a906a06 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action" status: 200 len: 29261 microversion: 2.20 time: 0.135186 Dec 14 03:17:44.248920 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 180/388] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:17:44 2021] POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action => generated 29261 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:17:44.765392 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-ebb37a8f-6bac-49da-8d7e-65dd8d843fbd tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:17:44.765993 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-ebb37a8f-6bac-49da-8d7e-65dd8d843fbd tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] [instance: cfd2456c-8f28-4be0-9c97-8e03b0fec041] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:44.772158 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ebb37a8f-6bac-49da-8d7e-65dd8d843fbd tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:44.772594 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ebb37a8f-6bac-49da-8d7e-65dd8d843fbd tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:44.773360 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ebb37a8f-6bac-49da-8d7e-65dd8d843fbd tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:44.773787 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ebb37a8f-6bac-49da-8d7e-65dd8d843fbd tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:44.805335 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-9b342364-24e8-47a2-a614-1c3c44b3c40b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:17:44.806390 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-9b342364-24e8-47a2-a614-1c3c44b3c40b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:44.813226 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-9b342364-24e8-47a2-a614-1c3c44b3c40b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:44.813682 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-9b342364-24e8-47a2-a614-1c3c44b3c40b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:44.815121 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-9b342364-24e8-47a2-a614-1c3c44b3c40b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:44.815516 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-9b342364-24e8-47a2-a614-1c3c44b3c40b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:44.898621 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-9b342364-24e8-47a2-a614-1c3c44b3c40b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action" status: 200 len: 28598 microversion: 2.1 time: 0.097048 Dec 14 03:17:44.902480 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 181/389] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:17:44 2021] POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action => generated 28598 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 14 03:17:44.902579 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-ebb37a8f-6bac-49da-8d7e-65dd8d843fbd tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d620fa9da54f588f753b3c497f00c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:17:44.909724 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-ebb37a8f-6bac-49da-8d7e-65dd8d843fbd tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041" status: 200 len: 1359 microversion: 2.1 time: 0.147925 Dec 14 03:17:44.910272 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 209/390] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:17:44 2021] GET /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041 => generated 1359 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:17:44.949715 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-2181ae3d-63b9-4d76-bada-c6a001c8d541 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:17:44.950568 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-2181ae3d-63b9-4d76-bada-c6a001c8d541 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:44.957512 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-2181ae3d-63b9-4d76-bada-c6a001c8d541 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:44.958084 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-2181ae3d-63b9-4d76-bada-c6a001c8d541 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:44.959673 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-2181ae3d-63b9-4d76-bada-c6a001c8d541 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:44.966323 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-2181ae3d-63b9-4d76-bada-c6a001c8d541 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:45.103477 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-2181ae3d-63b9-4d76-bada-c6a001c8d541 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:17:45.110855 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-2181ae3d-63b9-4d76-bada-c6a001c8d541 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe" status: 200 len: 1507 microversion: 2.1 time: 0.165395 Dec 14 03:17:45.112051 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 182/391] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:17:44 2021] GET /compute/v2.1/servers/e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe => generated 1507 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:17:45.127961 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-428eb4cd-193f-4b86-8d45-924f701c24e1 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e9e1a43c-93ea-4395-8c70-fee9478dbb21"}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:17:45.129022 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-428eb4cd-193f-4b86-8d45-924f701c24e1 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:45.134729 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-428eb4cd-193f-4b86-8d45-924f701c24e1 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:45.135224 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-428eb4cd-193f-4b86-8d45-924f701c24e1 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:45.136002 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-428eb4cd-193f-4b86-8d45-924f701c24e1 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:45.136439 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-428eb4cd-193f-4b86-8d45-924f701c24e1 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:45.177730 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [req-2f3f9e36-c040-4b8a-97a9-0123dc2489d1 req-c17b7bc8-0778-4396-a92e-9a097d697575 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfd2456c-8f28-4be0-9c97-8e03b0fec041", "name": "network-vif-plugged", "status": "completed", "tag": "bb3c28d2-c03d-4924-8dd8-da975e5427e4"}]} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:17:45.179363 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:17:45.179363 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: warnings.warn(msg) Dec 14 03:17:45.186462 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [req-2f3f9e36-c040-4b8a-97a9-0123dc2489d1 req-c17b7bc8-0778-4396-a92e-9a097d697575 service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:45.187228 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [req-2f3f9e36-c040-4b8a-97a9-0123dc2489d1 req-c17b7bc8-0778-4396-a92e-9a097d697575 service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:45.200406 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.compute.server_external_events [req-2f3f9e36-c040-4b8a-97a9-0123dc2489d1 req-c17b7bc8-0778-4396-a92e-9a097d697575 service nova] Creating event network-vif-plugged:bb3c28d2-c03d-4924-8dd8-da975e5427e4 for instance cfd2456c-8f28-4be0-9c97-8e03b0fec041 on hv-cinder-81803 Dec 14 03:17:45.205974 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [req-2f3f9e36-c040-4b8a-97a9-0123dc2489d1 req-c17b7bc8-0778-4396-a92e-9a097d697575 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032501 Dec 14 03:17:45.206934 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 183/392] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Dec 14 03:17:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 14 03:17:45.214592 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.wsgi [None req-428eb4cd-193f-4b86-8d45-924f701c24e1 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] HTTP exception thrown: Invalid volume: volume e9e1a43c-93ea-4395-8c70-fee9478dbb21 is already attached to instances: de04da40-f5fd-43e2-b454-20a219642030 Dec 14 03:17:45.215535 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-428eb4cd-193f-4b86-8d45-924f701c24e1 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Returning 400 to user: Invalid volume: volume e9e1a43c-93ea-4395-8c70-fee9478dbb21 is already attached to instances: de04da40-f5fd-43e2-b454-20a219642030 {{(pid=116072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 03:17:45.216393 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-428eb4cd-193f-4b86-8d45-924f701c24e1 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "POST /compute/v2.1/servers/e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.092265 Dec 14 03:17:45.216942 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 210/393] 10.222.0.43 () {60 vars in 1322 bytes} [Tue Dec 14 03:17:45 2021] POST /compute/v2.1/servers/e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe/os-volume_attachments => generated 174 bytes in 93 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 14 03:17:45.260706 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-56b2c860-e987-478f-b895-9543580f0177 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:17:45.261918 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-56b2c860-e987-478f-b895-9543580f0177 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:45.273958 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-56b2c860-e987-478f-b895-9543580f0177 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:45.274421 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-56b2c860-e987-478f-b895-9543580f0177 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:45.275298 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-56b2c860-e987-478f-b895-9543580f0177 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:45.275773 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-56b2c860-e987-478f-b895-9543580f0177 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:45.277664 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-295e4add-ece3-4e40-bf2d-6c703152eaa6 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:17:45.278196 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-295e4add-ece3-4e40-bf2d-6c703152eaa6 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: de04da40-f5fd-43e2-b454-20a219642030] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:45.285758 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-295e4add-ece3-4e40-bf2d-6c703152eaa6 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:45.286262 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-295e4add-ece3-4e40-bf2d-6c703152eaa6 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:45.287078 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-295e4add-ece3-4e40-bf2d-6c703152eaa6 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:45.287609 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-295e4add-ece3-4e40-bf2d-6c703152eaa6 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:45.361156 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-56b2c860-e987-478f-b895-9543580f0177 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action" status: 200 len: 29261 microversion: 2.20 time: 0.104450 Dec 14 03:17:45.365428 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 184/394] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:17:45 2021] POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action => generated 29261 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:17:45.414474 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.objects.instance [None req-295e4add-ece3-4e40-bf2d-6c703152eaa6 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lazy-loading 'services' on Instance uuid de04da40-f5fd-43e2-b454-20a219642030 {{(pid=116072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 14 03:17:45.525087 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-295e4add-ece3-4e40-bf2d-6c703152eaa6 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "DELETE /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030/os-volume_attachments/e9e1a43c-93ea-4395-8c70-fee9478dbb21" status: 202 len: 0 microversion: 2.1 time: 0.251062 Dec 14 03:17:45.525661 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 211/395] 10.222.0.43 () {58 vars in 1415 bytes} [Tue Dec 14 03:17:45 2021] DELETE /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030/os-volume_attachments/e9e1a43c-93ea-4395-8c70-fee9478dbb21 => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 14 03:17:45.534146 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-8c55fe59-98dc-4e6e-b207-0a5b08c500d8 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:17:45.535178 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-8c55fe59-98dc-4e6e-b207-0a5b08c500d8 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: de04da40-f5fd-43e2-b454-20a219642030] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:45.541924 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-8c55fe59-98dc-4e6e-b207-0a5b08c500d8 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:45.542374 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-8c55fe59-98dc-4e6e-b207-0a5b08c500d8 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:45.543253 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-8c55fe59-98dc-4e6e-b207-0a5b08c500d8 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:45.543696 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-8c55fe59-98dc-4e6e-b207-0a5b08c500d8 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:45.573498 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-8c55fe59-98dc-4e6e-b207-0a5b08c500d8 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043395 Dec 14 03:17:45.574044 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 185/396] 10.222.0.43 () {58 vars in 1301 bytes} [Tue Dec 14 03:17:45 2021] GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:17:45.910767 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-fc573294-8295-4ecd-83ef-ee62b886c0ae tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:17:45.911870 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-fc573294-8295-4ecd-83ef-ee62b886c0ae tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:45.917790 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-fc573294-8295-4ecd-83ef-ee62b886c0ae tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:45.918237 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-fc573294-8295-4ecd-83ef-ee62b886c0ae tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:45.919015 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-fc573294-8295-4ecd-83ef-ee62b886c0ae tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:45.919476 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-fc573294-8295-4ecd-83ef-ee62b886c0ae tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:45.928057 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-7783c44f-c3a5-4e58-b36f-1324e5a12b21 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:17:45.928669 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-7783c44f-c3a5-4e58-b36f-1324e5a12b21 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] [instance: cfd2456c-8f28-4be0-9c97-8e03b0fec041] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:45.934895 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-7783c44f-c3a5-4e58-b36f-1324e5a12b21 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:45.935373 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-7783c44f-c3a5-4e58-b36f-1324e5a12b21 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:45.936157 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-7783c44f-c3a5-4e58-b36f-1324e5a12b21 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:45.936733 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-7783c44f-c3a5-4e58-b36f-1324e5a12b21 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:46.069616 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-7783c44f-c3a5-4e58-b36f-1324e5a12b21 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d620fa9da54f588f753b3c497f00c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:17:46.072152 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-fc573294-8295-4ecd-83ef-ee62b886c0ae tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action" status: 200 len: 28598 microversion: 2.1 time: 0.165771 Dec 14 03:17:46.072796 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 212/397] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:17:45 2021] POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action => generated 28598 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:17:46.077338 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-7783c44f-c3a5-4e58-b36f-1324e5a12b21 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041" status: 200 len: 1359 microversion: 2.1 time: 0.154305 Dec 14 03:17:46.077889 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 186/398] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:17:45 2021] GET /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 03:17:46.373729 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-fa2e99a7-c243-44b8-95ed-c8aaa10b1471 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:17:46.374765 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-fa2e99a7-c243-44b8-95ed-c8aaa10b1471 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:46.383150 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-fa2e99a7-c243-44b8-95ed-c8aaa10b1471 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:46.383666 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-fa2e99a7-c243-44b8-95ed-c8aaa10b1471 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:46.384451 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-fa2e99a7-c243-44b8-95ed-c8aaa10b1471 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:46.384893 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-fa2e99a7-c243-44b8-95ed-c8aaa10b1471 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:46.584542 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-690141b9-14fd-4c29-ac3f-9e1992814a11 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:17:46.585440 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-690141b9-14fd-4c29-ac3f-9e1992814a11 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: de04da40-f5fd-43e2-b454-20a219642030] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:46.591648 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-690141b9-14fd-4c29-ac3f-9e1992814a11 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:46.592091 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-690141b9-14fd-4c29-ac3f-9e1992814a11 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:46.592854 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-690141b9-14fd-4c29-ac3f-9e1992814a11 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:46.593280 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-690141b9-14fd-4c29-ac3f-9e1992814a11 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:46.612247 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-fa2e99a7-c243-44b8-95ed-c8aaa10b1471 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action" status: 200 len: 29261 microversion: 2.20 time: 0.242348 Dec 14 03:17:46.613399 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 213/399] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:17:46 2021] POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action => generated 29261 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:17:46.621617 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-690141b9-14fd-4c29-ac3f-9e1992814a11 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040712 Dec 14 03:17:46.622086 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 187/400] 10.222.0.43 () {58 vars in 1301 bytes} [Tue Dec 14 03:17:46 2021] GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 14 03:17:47.087346 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-1a6642df-8836-4db6-89a1-9c744b933d8a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:17:47.087346 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-1a6642df-8836-4db6-89a1-9c744b933d8a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:47.092775 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1a6642df-8836-4db6-89a1-9c744b933d8a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:47.093225 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1a6642df-8836-4db6-89a1-9c744b933d8a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:47.094013 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1a6642df-8836-4db6-89a1-9c744b933d8a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:47.094446 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1a6642df-8836-4db6-89a1-9c744b933d8a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:47.094777 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-52945f8b-0fcc-43df-a6dc-0778674fc06c tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:17:47.095465 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-52945f8b-0fcc-43df-a6dc-0778674fc06c tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] [instance: cfd2456c-8f28-4be0-9c97-8e03b0fec041] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:47.102153 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-52945f8b-0fcc-43df-a6dc-0778674fc06c tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:47.102475 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-52945f8b-0fcc-43df-a6dc-0778674fc06c tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:47.103283 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-52945f8b-0fcc-43df-a6dc-0778674fc06c tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:47.103725 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-52945f8b-0fcc-43df-a6dc-0778674fc06c tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:47.237127 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-1a6642df-8836-4db6-89a1-9c744b933d8a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action" status: 200 len: 28598 microversion: 2.1 time: 0.155829 Dec 14 03:17:47.237494 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-52945f8b-0fcc-43df-a6dc-0778674fc06c tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d620fa9da54f588f753b3c497f00c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:17:47.238440 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 214/401] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:17:47 2021] POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action => generated 28598 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:17:47.244954 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-52945f8b-0fcc-43df-a6dc-0778674fc06c tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041" status: 200 len: 1359 microversion: 2.1 time: 0.153734 Dec 14 03:17:47.245505 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 188/402] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:17:47 2021] GET /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:17:47.624236 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-2c950725-b0c8-41fb-a5fc-ce457db21adc tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:17:47.625234 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-2c950725-b0c8-41fb-a5fc-ce457db21adc tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:47.632299 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2c950725-b0c8-41fb-a5fc-ce457db21adc tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:47.632498 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-a786ef35-6d80-4253-a636-d6039c6f8965 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:17:47.632896 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2c950725-b0c8-41fb-a5fc-ce457db21adc tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:47.633456 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-a786ef35-6d80-4253-a636-d6039c6f8965 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: de04da40-f5fd-43e2-b454-20a219642030] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:47.633665 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2c950725-b0c8-41fb-a5fc-ce457db21adc tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:47.634093 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2c950725-b0c8-41fb-a5fc-ce457db21adc tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:47.639563 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a786ef35-6d80-4253-a636-d6039c6f8965 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:47.640016 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a786ef35-6d80-4253-a636-d6039c6f8965 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:47.640789 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a786ef35-6d80-4253-a636-d6039c6f8965 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:47.641221 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a786ef35-6d80-4253-a636-d6039c6f8965 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:47.670846 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-a786ef35-6d80-4253-a636-d6039c6f8965 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041978 Dec 14 03:17:47.671436 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 189/403] 10.222.0.43 () {58 vars in 1301 bytes} [Tue Dec 14 03:17:47 2021] GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 14 03:17:47.729800 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-2c950725-b0c8-41fb-a5fc-ce457db21adc tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action" status: 200 len: 29261 microversion: 2.20 time: 0.109409 Dec 14 03:17:47.730438 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 215/404] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:17:47 2021] POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action => generated 29261 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:17:48.249038 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-4d5c0f92-e10d-4477-b74e-3df07e7cff26 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:17:48.249956 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-4d5c0f92-e10d-4477-b74e-3df07e7cff26 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:48.256297 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-4d5c0f92-e10d-4477-b74e-3df07e7cff26 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:48.256889 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-4d5c0f92-e10d-4477-b74e-3df07e7cff26 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:48.257669 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-4d5c0f92-e10d-4477-b74e-3df07e7cff26 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:48.258103 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-4d5c0f92-e10d-4477-b74e-3df07e7cff26 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:48.262312 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-8bae0dd7-ed57-4ff6-88ec-31ceba836ca2 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:17:48.263289 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-8bae0dd7-ed57-4ff6-88ec-31ceba836ca2 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] [instance: cfd2456c-8f28-4be0-9c97-8e03b0fec041] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:48.270825 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8bae0dd7-ed57-4ff6-88ec-31ceba836ca2 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:48.271298 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8bae0dd7-ed57-4ff6-88ec-31ceba836ca2 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:48.272074 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8bae0dd7-ed57-4ff6-88ec-31ceba836ca2 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:48.272501 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8bae0dd7-ed57-4ff6-88ec-31ceba836ca2 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:48.367018 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-4d5c0f92-e10d-4477-b74e-3df07e7cff26 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action" status: 200 len: 28598 microversion: 2.1 time: 0.121353 Dec 14 03:17:48.373005 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 190/405] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:17:48 2021] POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action => generated 28598 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:17:48.426433 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-8bae0dd7-ed57-4ff6-88ec-31ceba836ca2 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d620fa9da54f588f753b3c497f00c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:17:48.433723 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-8bae0dd7-ed57-4ff6-88ec-31ceba836ca2 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041" status: 200 len: 1549 microversion: 2.1 time: 0.175558 Dec 14 03:17:48.434349 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 216/406] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:17:48 2021] GET /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041 => generated 1549 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 03:17:48.451938 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-64308a4f-4435-4b87-b065-90fed29d3655 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:17:48.452641 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-64308a4f-4435-4b87-b065-90fed29d3655 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] [instance: cfd2456c-8f28-4be0-9c97-8e03b0fec041] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:48.459619 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-64308a4f-4435-4b87-b065-90fed29d3655 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:48.460074 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-64308a4f-4435-4b87-b065-90fed29d3655 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:48.460842 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-64308a4f-4435-4b87-b065-90fed29d3655 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:48.461281 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-64308a4f-4435-4b87-b065-90fed29d3655 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:48.593350 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-64308a4f-4435-4b87-b065-90fed29d3655 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d620fa9da54f588f753b3c497f00c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:17:48.600573 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-64308a4f-4435-4b87-b065-90fed29d3655 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041" status: 200 len: 1549 microversion: 2.1 time: 0.152629 Dec 14 03:17:48.601127 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 191/407] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:17:48 2021] GET /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041 => generated 1549 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:17:48.616542 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-3167fe54-3658-4598-bb15-5ca83d35d614 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:17:48.620047 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:17:48.620047 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: warnings.warn(msg) Dec 14 03:17:48.621101 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-3167fe54-3658-4598-bb15-5ca83d35d614 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f1d620fa9da54f588f753b3c497f00c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:17:48.621832 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-3167fe54-3658-4598-bb15-5ca83d35d614 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Searching by: {'deleted': False, 'project_id': 'bc2e5ee76edf4e358f418773bf824ed7'} {{(pid=116072) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 14 03:17:48.631869 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3167fe54-3658-4598-bb15-5ca83d35d614 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:48.632452 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3167fe54-3658-4598-bb15-5ca83d35d614 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:48.633096 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3167fe54-3658-4598-bb15-5ca83d35d614 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:48.633526 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3167fe54-3658-4598-bb15-5ca83d35d614 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:48.681796 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-e42f5546-f32d-4cd7-b8dd-69cf63f00384 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:17:48.682779 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-e42f5546-f32d-4cd7-b8dd-69cf63f00384 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: de04da40-f5fd-43e2-b454-20a219642030] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:48.688524 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-e42f5546-f32d-4cd7-b8dd-69cf63f00384 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:48.689004 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-e42f5546-f32d-4cd7-b8dd-69cf63f00384 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:48.689786 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-e42f5546-f32d-4cd7-b8dd-69cf63f00384 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:48.690222 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-e42f5546-f32d-4cd7-b8dd-69cf63f00384 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:48.717917 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-e42f5546-f32d-4cd7-b8dd-69cf63f00384 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040076 Dec 14 03:17:48.718473 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 192/408] 10.222.0.43 () {58 vars in 1301 bytes} [Tue Dec 14 03:17:48 2021] GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 14 03:17:48.719985 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.multi_cell_list [None req-3167fe54-3658-4598-bb15-5ca83d35d614 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=116072) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 14 03:17:48.741636 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-addca2a4-2e0e-4470-a95d-b5443b00b075 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:17:48.742544 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-addca2a4-2e0e-4470-a95d-b5443b00b075 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:48.748762 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-addca2a4-2e0e-4470-a95d-b5443b00b075 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:48.749215 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-addca2a4-2e0e-4470-a95d-b5443b00b075 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:48.749992 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-addca2a4-2e0e-4470-a95d-b5443b00b075 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:48.750429 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-addca2a4-2e0e-4470-a95d-b5443b00b075 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:48.811931 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-3167fe54-3658-4598-bb15-5ca83d35d614 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.199182 Dec 14 03:17:48.812510 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 217/409] 10.222.0.43 () {58 vars in 1124 bytes} [Tue Dec 14 03:17:48 2021] GET /compute/v2.1/servers => generated 343 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:17:48.821806 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-6e760ef9-5e7f-4375-8098-30bfe91e1c20 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:17:48.822402 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-6e760ef9-5e7f-4375-8098-30bfe91e1c20 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] [instance: cfd2456c-8f28-4be0-9c97-8e03b0fec041] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:48.827816 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6e760ef9-5e7f-4375-8098-30bfe91e1c20 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:48.828260 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6e760ef9-5e7f-4375-8098-30bfe91e1c20 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:48.829014 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6e760ef9-5e7f-4375-8098-30bfe91e1c20 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:48.829443 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6e760ef9-5e7f-4375-8098-30bfe91e1c20 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:48.848741 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-addca2a4-2e0e-4470-a95d-b5443b00b075 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action" status: 200 len: 29261 microversion: 2.20 time: 0.110599 Dec 14 03:17:48.852702 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 193/410] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:17:48 2021] POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action => generated 29261 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 14 03:17:48.957571 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-6e760ef9-5e7f-4375-8098-30bfe91e1c20 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d620fa9da54f588f753b3c497f00c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:17:48.964642 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-6e760ef9-5e7f-4375-8098-30bfe91e1c20 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041" status: 200 len: 1549 microversion: 2.1 time: 0.146080 Dec 14 03:17:48.965192 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 218/411] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:17:48 2021] GET /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041 => generated 1549 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 03:17:49.381510 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-211196fb-a715-4bc4-95f8-22fa6106ec1b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:17:49.382541 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-211196fb-a715-4bc4-95f8-22fa6106ec1b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:49.389279 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-211196fb-a715-4bc4-95f8-22fa6106ec1b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:49.389732 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-211196fb-a715-4bc4-95f8-22fa6106ec1b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:49.390507 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-211196fb-a715-4bc4-95f8-22fa6106ec1b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:49.390943 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-211196fb-a715-4bc4-95f8-22fa6106ec1b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:49.491619 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-211196fb-a715-4bc4-95f8-22fa6106ec1b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action" status: 200 len: 28598 microversion: 2.1 time: 0.115332 Dec 14 03:17:49.492273 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 194/412] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:17:49 2021] POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action => generated 28598 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:17:49.728873 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-980e012c-831a-46d2-b355-71c3909a4ec0 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:17:49.729717 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-980e012c-831a-46d2-b355-71c3909a4ec0 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: de04da40-f5fd-43e2-b454-20a219642030] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:49.735996 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-980e012c-831a-46d2-b355-71c3909a4ec0 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:49.736444 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-980e012c-831a-46d2-b355-71c3909a4ec0 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:49.737214 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-980e012c-831a-46d2-b355-71c3909a4ec0 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:49.737646 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-980e012c-831a-46d2-b355-71c3909a4ec0 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:49.768837 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-980e012c-831a-46d2-b355-71c3909a4ec0 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043782 Dec 14 03:17:49.769381 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 219/413] 10.222.0.43 () {58 vars in 1301 bytes} [Tue Dec 14 03:17:49 2021] GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:17:49.860692 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-7bf9c91f-4389-43d2-b731-eeea970e6fc9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:17:49.862217 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-7bf9c91f-4389-43d2-b731-eeea970e6fc9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:49.869245 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-7bf9c91f-4389-43d2-b731-eeea970e6fc9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:49.869703 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-7bf9c91f-4389-43d2-b731-eeea970e6fc9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:49.870480 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-7bf9c91f-4389-43d2-b731-eeea970e6fc9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:49.870918 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-7bf9c91f-4389-43d2-b731-eeea970e6fc9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:49.971091 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-7bf9c91f-4389-43d2-b731-eeea970e6fc9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action" status: 200 len: 29261 microversion: 2.20 time: 0.114249 Dec 14 03:17:49.972007 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 195/414] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:17:49 2021] POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action => generated 29261 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:17:50.504709 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-a5694b9f-dcd2-4392-a990-d626baf27072 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:17:50.505722 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-a5694b9f-dcd2-4392-a990-d626baf27072 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:50.511535 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a5694b9f-dcd2-4392-a990-d626baf27072 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:50.511982 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a5694b9f-dcd2-4392-a990-d626baf27072 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:50.512795 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a5694b9f-dcd2-4392-a990-d626baf27072 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:50.513229 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a5694b9f-dcd2-4392-a990-d626baf27072 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:50.619915 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-a5694b9f-dcd2-4392-a990-d626baf27072 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action" status: 200 len: 28598 microversion: 2.1 time: 0.120592 Dec 14 03:17:50.620570 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 220/415] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:17:50 2021] POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action => generated 28598 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:17:50.780662 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-ae899a6a-5ef0-4c17-9cbb-16e65fbf6e08 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:17:50.781590 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-ae899a6a-5ef0-4c17-9cbb-16e65fbf6e08 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: de04da40-f5fd-43e2-b454-20a219642030] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:50.788999 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ae899a6a-5ef0-4c17-9cbb-16e65fbf6e08 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:50.789455 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ae899a6a-5ef0-4c17-9cbb-16e65fbf6e08 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:50.790239 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ae899a6a-5ef0-4c17-9cbb-16e65fbf6e08 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:50.790679 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ae899a6a-5ef0-4c17-9cbb-16e65fbf6e08 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:50.818897 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-ae899a6a-5ef0-4c17-9cbb-16e65fbf6e08 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042400 Dec 14 03:17:50.819462 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 196/416] 10.222.0.43 () {58 vars in 1301 bytes} [Tue Dec 14 03:17:50 2021] GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:17:50.983151 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-d481b23b-45ad-4c5f-8cb7-51a52b59d943 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:17:50.984148 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-d481b23b-45ad-4c5f-8cb7-51a52b59d943 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:50.991232 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d481b23b-45ad-4c5f-8cb7-51a52b59d943 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:50.991680 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d481b23b-45ad-4c5f-8cb7-51a52b59d943 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:50.992455 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d481b23b-45ad-4c5f-8cb7-51a52b59d943 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:50.992887 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d481b23b-45ad-4c5f-8cb7-51a52b59d943 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:51.104940 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-d481b23b-45ad-4c5f-8cb7-51a52b59d943 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action" status: 200 len: 29261 microversion: 2.20 time: 0.125780 Dec 14 03:17:51.105567 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 221/417] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:17:50 2021] POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action => generated 29261 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:17:51.631828 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-156171bc-ea91-474b-b449-4547f9b176f4 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:17:51.632741 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-156171bc-ea91-474b-b449-4547f9b176f4 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:51.638832 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-156171bc-ea91-474b-b449-4547f9b176f4 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:51.639306 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-156171bc-ea91-474b-b449-4547f9b176f4 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:51.640074 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-156171bc-ea91-474b-b449-4547f9b176f4 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:51.640506 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-156171bc-ea91-474b-b449-4547f9b176f4 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:51.737354 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-156171bc-ea91-474b-b449-4547f9b176f4 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action" status: 200 len: 28598 microversion: 2.1 time: 0.108936 Dec 14 03:17:51.737904 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 197/418] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:17:51 2021] POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action => generated 28598 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:17:51.830826 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-14bb1bbc-db90-4315-85eb-b6398be9103b tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:17:51.831852 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-14bb1bbc-db90-4315-85eb-b6398be9103b tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: de04da40-f5fd-43e2-b454-20a219642030] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:51.838594 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-14bb1bbc-db90-4315-85eb-b6398be9103b tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:51.839059 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-14bb1bbc-db90-4315-85eb-b6398be9103b tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:51.839837 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-14bb1bbc-db90-4315-85eb-b6398be9103b tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:51.840271 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-14bb1bbc-db90-4315-85eb-b6398be9103b tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:51.872376 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-14bb1bbc-db90-4315-85eb-b6398be9103b tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046209 Dec 14 03:17:51.872927 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 222/419] 10.222.0.43 () {58 vars in 1301 bytes} [Tue Dec 14 03:17:51 2021] GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:17:52.117782 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-af6b2e03-e606-460d-b5b5-87fe9caaef00 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:17:52.118791 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-af6b2e03-e606-460d-b5b5-87fe9caaef00 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:52.125565 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-af6b2e03-e606-460d-b5b5-87fe9caaef00 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:52.126014 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-af6b2e03-e606-460d-b5b5-87fe9caaef00 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:52.127435 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-af6b2e03-e606-460d-b5b5-87fe9caaef00 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:52.127875 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-af6b2e03-e606-460d-b5b5-87fe9caaef00 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:52.221575 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-af6b2e03-e606-460d-b5b5-87fe9caaef00 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action" status: 200 len: 29261 microversion: 2.20 time: 0.107684 Dec 14 03:17:52.222204 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 198/420] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:17:52 2021] POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action => generated 29261 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:17:52.748846 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-391e4b11-39af-4add-b8f2-511db3cd082c tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:17:52.749760 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-391e4b11-39af-4add-b8f2-511db3cd082c tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:52.755966 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-391e4b11-39af-4add-b8f2-511db3cd082c tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:52.756418 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-391e4b11-39af-4add-b8f2-511db3cd082c tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:52.757197 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-391e4b11-39af-4add-b8f2-511db3cd082c tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:52.757637 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-391e4b11-39af-4add-b8f2-511db3cd082c tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:52.851813 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-391e4b11-39af-4add-b8f2-511db3cd082c tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action" status: 200 len: 28598 microversion: 2.1 time: 0.106470 Dec 14 03:17:52.852428 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 223/421] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:17:52 2021] POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action => generated 28598 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:17:52.884055 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-922ca081-73d0-4c1f-b38b-49e48d422cbc tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:17:52.885043 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-922ca081-73d0-4c1f-b38b-49e48d422cbc tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: de04da40-f5fd-43e2-b454-20a219642030] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:52.891767 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-922ca081-73d0-4c1f-b38b-49e48d422cbc tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:52.892718 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-922ca081-73d0-4c1f-b38b-49e48d422cbc tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:52.893489 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-922ca081-73d0-4c1f-b38b-49e48d422cbc tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:52.893919 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-922ca081-73d0-4c1f-b38b-49e48d422cbc tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:52.923387 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-922ca081-73d0-4c1f-b38b-49e48d422cbc tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043245 Dec 14 03:17:52.923857 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 199/422] 10.222.0.43 () {58 vars in 1301 bytes} [Tue Dec 14 03:17:52 2021] GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:17:53.233148 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-acb0a44e-de0a-4498-85e8-94d3db1ec804 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:17:53.234066 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-acb0a44e-de0a-4498-85e8-94d3db1ec804 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:53.241129 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-acb0a44e-de0a-4498-85e8-94d3db1ec804 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:53.241582 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-acb0a44e-de0a-4498-85e8-94d3db1ec804 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:53.242363 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-acb0a44e-de0a-4498-85e8-94d3db1ec804 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:53.242812 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-acb0a44e-de0a-4498-85e8-94d3db1ec804 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:53.340495 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-acb0a44e-de0a-4498-85e8-94d3db1ec804 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action" status: 200 len: 29261 microversion: 2.20 time: 0.111276 Dec 14 03:17:53.344492 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 224/423] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:17:53 2021] POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action => generated 29261 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:17:53.864539 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-5e548bcd-1c6b-4291-b8cb-3138d25e4eff tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:17:53.865388 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-5e548bcd-1c6b-4291-b8cb-3138d25e4eff tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:53.871669 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-5e548bcd-1c6b-4291-b8cb-3138d25e4eff tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:53.872124 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-5e548bcd-1c6b-4291-b8cb-3138d25e4eff tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:53.872895 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-5e548bcd-1c6b-4291-b8cb-3138d25e4eff tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:53.873331 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-5e548bcd-1c6b-4291-b8cb-3138d25e4eff tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:53.935719 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-d0d8b49e-e6fe-4ef1-82a0-1c798c1fef0a tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:17:53.937357 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-d0d8b49e-e6fe-4ef1-82a0-1c798c1fef0a tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: de04da40-f5fd-43e2-b454-20a219642030] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:53.943753 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d0d8b49e-e6fe-4ef1-82a0-1c798c1fef0a tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:53.944246 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d0d8b49e-e6fe-4ef1-82a0-1c798c1fef0a tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:53.945027 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d0d8b49e-e6fe-4ef1-82a0-1c798c1fef0a tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:53.945463 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d0d8b49e-e6fe-4ef1-82a0-1c798c1fef0a tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:53.972766 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-5e548bcd-1c6b-4291-b8cb-3138d25e4eff tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action" status: 200 len: 28598 microversion: 2.1 time: 0.112521 Dec 14 03:17:53.973771 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 200/424] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:17:53 2021] POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action => generated 28598 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:17:53.979241 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-d0d8b49e-e6fe-4ef1-82a0-1c798c1fef0a tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048004 Dec 14 03:17:53.979792 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 225/425] 10.222.0.43 () {58 vars in 1301 bytes} [Tue Dec 14 03:17:53 2021] GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 14 03:17:54.352305 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-11edce34-7428-4948-80ec-7130328338b2 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:17:54.353311 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-11edce34-7428-4948-80ec-7130328338b2 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:54.360122 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-11edce34-7428-4948-80ec-7130328338b2 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:54.360578 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-11edce34-7428-4948-80ec-7130328338b2 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:54.361358 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-11edce34-7428-4948-80ec-7130328338b2 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:54.361800 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-11edce34-7428-4948-80ec-7130328338b2 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:54.984525 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-3cb0915a-f7a3-49be-b592-fe170ab6c084 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:17:54.985358 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-3cb0915a-f7a3-49be-b592-fe170ab6c084 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:54.992518 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3cb0915a-f7a3-49be-b592-fe170ab6c084 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:54.992968 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3cb0915a-f7a3-49be-b592-fe170ab6c084 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:54.993742 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3cb0915a-f7a3-49be-b592-fe170ab6c084 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:54.994176 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3cb0915a-f7a3-49be-b592-fe170ab6c084 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:58.214006 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-11edce34-7428-4948-80ec-7130328338b2 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action" status: 200 len: 29261 microversion: 2.20 time: 3.865563 Dec 14 03:17:58.215020 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 201/426] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:17:54 2021] POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action => generated 29261 bytes in 3868 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:17:58.219767 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-c3f56709-34bb-43b2-a9fb-07fb86b79d2b tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:17:58.220762 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-c3f56709-34bb-43b2-a9fb-07fb86b79d2b tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: de04da40-f5fd-43e2-b454-20a219642030] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:58.228101 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c3f56709-34bb-43b2-a9fb-07fb86b79d2b tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:58.228550 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c3f56709-34bb-43b2-a9fb-07fb86b79d2b tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:58.229331 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c3f56709-34bb-43b2-a9fb-07fb86b79d2b tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:58.229772 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c3f56709-34bb-43b2-a9fb-07fb86b79d2b tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:58.245737 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-3cb0915a-f7a3-49be-b592-fe170ab6c084 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action" status: 200 len: 28598 microversion: 2.1 time: 3.264764 Dec 14 03:17:58.246747 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 226/427] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:17:54 2021] POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action => generated 28598 bytes in 3266 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 14 03:17:58.261387 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-c3f56709-34bb-43b2-a9fb-07fb86b79d2b tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045283 Dec 14 03:17:58.261955 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 202/428] 10.222.0.43 () {58 vars in 1301 bytes} [Tue Dec 14 03:17:58 2021] GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:17:59.226397 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-046f9c54-5631-4c0f-aa54-7e26cc9a4b53 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:17:59.227362 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-046f9c54-5631-4c0f-aa54-7e26cc9a4b53 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:59.235005 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-046f9c54-5631-4c0f-aa54-7e26cc9a4b53 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:59.235492 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-046f9c54-5631-4c0f-aa54-7e26cc9a4b53 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:59.236264 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-046f9c54-5631-4c0f-aa54-7e26cc9a4b53 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:59.236694 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-046f9c54-5631-4c0f-aa54-7e26cc9a4b53 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:59.257819 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-b56acd08-d15b-4e06-81ea-191c514a6b27 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:17:59.258809 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-b56acd08-d15b-4e06-81ea-191c514a6b27 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:59.265967 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b56acd08-d15b-4e06-81ea-191c514a6b27 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:59.266416 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b56acd08-d15b-4e06-81ea-191c514a6b27 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:59.267836 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b56acd08-d15b-4e06-81ea-191c514a6b27 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:59.268349 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b56acd08-d15b-4e06-81ea-191c514a6b27 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:59.367956 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-046f9c54-5631-4c0f-aa54-7e26cc9a4b53 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action" status: 200 len: 29261 microversion: 2.20 time: 0.145483 Dec 14 03:17:59.368855 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 227/429] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:17:59 2021] POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action => generated 29261 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:17:59.373766 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-8e9a1031-25c0-44d7-ac53-763e16151dcb tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:17:59.374748 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-8e9a1031-25c0-44d7-ac53-763e16151dcb tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: de04da40-f5fd-43e2-b454-20a219642030] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:59.382189 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8e9a1031-25c0-44d7-ac53-763e16151dcb tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:59.382637 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8e9a1031-25c0-44d7-ac53-763e16151dcb tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:59.383444 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8e9a1031-25c0-44d7-ac53-763e16151dcb tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:59.383878 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8e9a1031-25c0-44d7-ac53-763e16151dcb tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:59.395983 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-b56acd08-d15b-4e06-81ea-191c514a6b27 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action" status: 200 len: 28598 microversion: 2.1 time: 0.141583 Dec 14 03:17:59.397476 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 203/430] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:17:59 2021] POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action => generated 28598 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 14 03:17:59.414954 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-8e9a1031-25c0-44d7-ac53-763e16151dcb tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044913 Dec 14 03:17:59.415554 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 228/431] 10.222.0.43 () {58 vars in 1301 bytes} [Tue Dec 14 03:17:59 2021] GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:17:59.732455 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-008f40bc-3cb5-49cb-a50e-15d11c19af08 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:17:59.733554 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-008f40bc-3cb5-49cb-a50e-15d11c19af08 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: 4687b559-c95a-4b82-a076-a7468c10ebef] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:59.741817 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-008f40bc-3cb5-49cb-a50e-15d11c19af08 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:59.742273 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-008f40bc-3cb5-49cb-a50e-15d11c19af08 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:59.743106 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-008f40bc-3cb5-49cb-a50e-15d11c19af08 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:59.743557 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-008f40bc-3cb5-49cb-a50e-15d11c19af08 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:59.769732 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.objects.instance [None req-008f40bc-3cb5-49cb-a50e-15d11c19af08 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lazy-loading 'flavor' on Instance uuid 4687b559-c95a-4b82-a076-a7468c10ebef {{(pid=116071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 14 03:17:59.899195 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-008f40bc-3cb5-49cb-a50e-15d11c19af08 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "POST /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef/action" status: 200 len: 32 microversion: 2.1 time: 0.171009 Dec 14 03:17:59.899804 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 204/432] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:17:59 2021] POST /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef/action => generated 32 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 14 03:17:59.925155 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-8ba2abe9-c777-4c7f-993e-4e4d556e841b tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:17:59.925773 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-8ba2abe9-c777-4c7f-993e-4e4d556e841b tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: 4687b559-c95a-4b82-a076-a7468c10ebef] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:17:59.934189 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8ba2abe9-c777-4c7f-993e-4e4d556e841b tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:59.934645 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8ba2abe9-c777-4c7f-993e-4e4d556e841b tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:17:59.935455 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8ba2abe9-c777-4c7f-993e-4e4d556e841b tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:17:59.935890 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8ba2abe9-c777-4c7f-993e-4e4d556e841b tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:00.053982 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-b5d49417-74c3-4f3e-84c8-8bd3bff56f80 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dc386862-c00f-4e23-95dc-baf94c91b9a7"}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:18:00.056215 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-b5d49417-74c3-4f3e-84c8-8bd3bff56f80 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] [instance: cfd2456c-8f28-4be0-9c97-8e03b0fec041] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:00.066504 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b5d49417-74c3-4f3e-84c8-8bd3bff56f80 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:00.067052 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b5d49417-74c3-4f3e-84c8-8bd3bff56f80 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:00.068121 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b5d49417-74c3-4f3e-84c8-8bd3bff56f80 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:00.068625 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b5d49417-74c3-4f3e-84c8-8bd3bff56f80 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:00.169583 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-8ba2abe9-c777-4c7f-993e-4e4d556e841b tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:00.180567 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-8ba2abe9-c777-4c7f-993e-4e4d556e841b tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef" status: 200 len: 1567 microversion: 2.1 time: 0.264434 Dec 14 03:18:00.181587 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 229/433] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:17:59 2021] GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef => generated 1567 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:18:00.381624 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-11e6c3cf-6f2e-43cd-ba50-ca265b60ee72 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:18:00.382680 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-11e6c3cf-6f2e-43cd-ba50-ca265b60ee72 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:00.391274 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-11e6c3cf-6f2e-43cd-ba50-ca265b60ee72 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:00.391274 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-11e6c3cf-6f2e-43cd-ba50-ca265b60ee72 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:00.391274 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-11e6c3cf-6f2e-43cd-ba50-ca265b60ee72 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:00.392363 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-11e6c3cf-6f2e-43cd-ba50-ca265b60ee72 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:00.465882 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-b5d49417-74c3-4f3e-84c8-8bd3bff56f80 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "POST /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.416349 Dec 14 03:18:00.466984 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 205/434] 10.222.0.43 () {60 vars in 1322 bytes} [Tue Dec 14 03:18:00 2021] POST /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041/os-volume_attachments => generated 194 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 14 03:18:00.472688 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-bfc973bd-66bc-46e4-8fc9-ef5ce011a1b8 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:18:00.476246 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-bfc973bd-66bc-46e4-8fc9-ef5ce011a1b8 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:00.484073 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-bfc973bd-66bc-46e4-8fc9-ef5ce011a1b8 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:00.484529 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-bfc973bd-66bc-46e4-8fc9-ef5ce011a1b8 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:00.485564 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-bfc973bd-66bc-46e4-8fc9-ef5ce011a1b8 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:00.486015 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-bfc973bd-66bc-46e4-8fc9-ef5ce011a1b8 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:00.530869 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-11e6c3cf-6f2e-43cd-ba50-ca265b60ee72 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action" status: 200 len: 29261 microversion: 2.20 time: 0.147380 Dec 14 03:18:00.530869 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 230/435] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:18:00 2021] POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action => generated 29261 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:18:00.530869 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-3ed4738c-8ceb-4993-86a3-229015aa3a50 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:00.531590 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-3ed4738c-8ceb-4993-86a3-229015aa3a50 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: de04da40-f5fd-43e2-b454-20a219642030] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:00.538930 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3ed4738c-8ceb-4993-86a3-229015aa3a50 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:00.539405 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3ed4738c-8ceb-4993-86a3-229015aa3a50 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:00.540195 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3ed4738c-8ceb-4993-86a3-229015aa3a50 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:00.540632 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3ed4738c-8ceb-4993-86a3-229015aa3a50 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:00.570781 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-3ed4738c-8ceb-4993-86a3-229015aa3a50 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044276 Dec 14 03:18:00.571365 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 231/436] 10.222.0.43 () {58 vars in 1301 bytes} [Tue Dec 14 03:18:00 2021] GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:18:00.632508 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-bfc973bd-66bc-46e4-8fc9-ef5ce011a1b8 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action" status: 200 len: 28598 microversion: 2.1 time: 0.163961 Dec 14 03:18:00.633402 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 206/437] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:18:00 2021] POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action => generated 28598 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:18:01.196909 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-7ac0077a-6096-4348-b888-7eb8e1e568bf tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:01.197487 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-7ac0077a-6096-4348-b888-7eb8e1e568bf tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: 4687b559-c95a-4b82-a076-a7468c10ebef] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:01.203738 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7ac0077a-6096-4348-b888-7eb8e1e568bf tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:01.204191 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7ac0077a-6096-4348-b888-7eb8e1e568bf tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:01.204966 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7ac0077a-6096-4348-b888-7eb8e1e568bf tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:01.205402 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7ac0077a-6096-4348-b888-7eb8e1e568bf tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:01.332839 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-7ac0077a-6096-4348-b888-7eb8e1e568bf tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:01.340389 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-7ac0077a-6096-4348-b888-7eb8e1e568bf tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef" status: 200 len: 1567 microversion: 2.1 time: 0.147148 Dec 14 03:18:01.340940 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 232/438] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:18:01 2021] GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef => generated 1567 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:18:01.535643 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-62eff326-ff34-43fe-b55b-9c288b6d21a9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:18:01.536865 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-62eff326-ff34-43fe-b55b-9c288b6d21a9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:01.544076 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-62eff326-ff34-43fe-b55b-9c288b6d21a9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:01.544527 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-62eff326-ff34-43fe-b55b-9c288b6d21a9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:01.545307 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-62eff326-ff34-43fe-b55b-9c288b6d21a9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:01.545740 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-62eff326-ff34-43fe-b55b-9c288b6d21a9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:01.581993 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-9ee7ba71-a0cc-49b1-be13-169e0b9364f9 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:01.582897 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-9ee7ba71-a0cc-49b1-be13-169e0b9364f9 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: de04da40-f5fd-43e2-b454-20a219642030] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:01.589344 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9ee7ba71-a0cc-49b1-be13-169e0b9364f9 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:01.589799 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9ee7ba71-a0cc-49b1-be13-169e0b9364f9 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:01.590577 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9ee7ba71-a0cc-49b1-be13-169e0b9364f9 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:01.591013 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9ee7ba71-a0cc-49b1-be13-169e0b9364f9 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:01.619886 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-9ee7ba71-a0cc-49b1-be13-169e0b9364f9 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042028 Dec 14 03:18:01.620448 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 233/439] 10.222.0.43 () {58 vars in 1301 bytes} [Tue Dec 14 03:18:01 2021] GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 14 03:18:01.644631 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-7fee90aa-3dfb-4980-972f-14a702b9013b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:18:01.645587 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-7fee90aa-3dfb-4980-972f-14a702b9013b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:01.651207 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-62eff326-ff34-43fe-b55b-9c288b6d21a9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action" status: 200 len: 29261 microversion: 2.20 time: 0.119495 Dec 14 03:18:01.651441 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7fee90aa-3dfb-4980-972f-14a702b9013b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:01.655604 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 207/440] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:18:01 2021] POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action => generated 29261 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:18:01.655767 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7fee90aa-3dfb-4980-972f-14a702b9013b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:01.655767 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7fee90aa-3dfb-4980-972f-14a702b9013b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:01.655767 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7fee90aa-3dfb-4980-972f-14a702b9013b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:01.754987 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-7fee90aa-3dfb-4980-972f-14a702b9013b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action" status: 200 len: 28598 microversion: 2.1 time: 0.110392 Dec 14 03:18:01.756934 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 234/441] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:18:01 2021] POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action => generated 28598 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 14 03:18:01.830762 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-e6892796-a5d1-490b-9d17-1883c54925fd tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1266082511", "imageRef": "4fff76a9-6620-4bda-b1ec-2cd3719c946a", "flavorRef": "452", "networks": [{"uuid": "69a3889e-636a-4983-9398-edafd7db5301"}]}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:18:01.881261 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.network.neutron [None req-e6892796-a5d1-490b-9d17-1883c54925fd tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] validate_networks() for [('69a3889e-636a-4983-9398-edafd7db5301', None, None, None, None, None)] {{(pid=116071) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 14 03:18:02.238730 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.virt.hardware [None req-e6892796-a5d1-490b-9d17-1883c54925fd tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Flavor limits 0:0:0 {{(pid=116071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 14 03:18:02.239228 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.virt.hardware [None req-e6892796-a5d1-490b-9d17-1883c54925fd tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Image limits 0:0:0 {{(pid=116071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 14 03:18:02.239705 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.virt.hardware [None req-e6892796-a5d1-490b-9d17-1883c54925fd tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Flavor pref 0:0:0 {{(pid=116071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 14 03:18:02.240119 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.virt.hardware [None req-e6892796-a5d1-490b-9d17-1883c54925fd tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Image pref 0:0:0 {{(pid=116071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 14 03:18:02.240534 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.virt.hardware [None req-e6892796-a5d1-490b-9d17-1883c54925fd tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 14 03:18:02.251669 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-e6892796-a5d1-490b-9d17-1883c54925fd tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:02.252122 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-e6892796-a5d1-490b-9d17-1883c54925fd tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:02.252948 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-e6892796-a5d1-490b-9d17-1883c54925fd tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:02.253389 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-e6892796-a5d1-490b-9d17-1883c54925fd tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:02.269568 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.quota [None req-e6892796-a5d1-490b-9d17-1883c54925fd tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Getting quotas for project 7ecea5c13a624ab8a3a445d3ede5fd77. Resources: {'cores', 'instances', 'ram'} {{(pid=116071) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 03:18:02.273476 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.quota [None req-e6892796-a5d1-490b-9d17-1883c54925fd tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Getting quotas for user 0a133cb1175e4130902bbcdeaedd74f9 and project 7ecea5c13a624ab8a3a445d3ede5fd77. Resources: {'cores', 'instances', 'ram'} {{(pid=116071) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 03:18:02.284429 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-e6892796-a5d1-490b-9d17-1883c54925fd tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Going to run 1 instances... {{(pid=116071) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 14 03:18:02.286786 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-e6892796-a5d1-490b-9d17-1883c54925fd tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: 095d132d-1529-4a41-a033-a8b41a1af328] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4fff76a9-6620-4bda-b1ec-2cd3719c946a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 14 03:18:02.328706 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-e6892796-a5d1-490b-9d17-1883c54925fd tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.502173 Dec 14 03:18:02.329556 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 208/442] 10.222.0.43 () {60 vars in 1146 bytes} [Tue Dec 14 03:18:01 2021] POST /compute/v2.1/servers => generated 380 bytes in 504 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 14 03:18:02.339579 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-12d7d3a2-83ec-4b81-9de0-a5d596abec92 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:02.340296 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-12d7d3a2-83ec-4b81-9de0-a5d596abec92 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: 095d132d-1529-4a41-a033-a8b41a1af328] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:02.357234 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-a1723f90-86c4-4db4-86f4-c58d61ca729c tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:02.357885 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-a1723f90-86c4-4db4-86f4-c58d61ca729c tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: 4687b559-c95a-4b82-a076-a7468c10ebef] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:02.365979 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a1723f90-86c4-4db4-86f4-c58d61ca729c tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:02.366562 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a1723f90-86c4-4db4-86f4-c58d61ca729c tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:02.367401 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a1723f90-86c4-4db4-86f4-c58d61ca729c tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:02.367845 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a1723f90-86c4-4db4-86f4-c58d61ca729c tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:02.402378 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-12d7d3a2-83ec-4b81-9de0-a5d596abec92 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:02.409833 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-12d7d3a2-83ec-4b81-9de0-a5d596abec92 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/095d132d-1529-4a41-a033-a8b41a1af328" status: 200 len: 1218 microversion: 2.1 time: 0.074131 Dec 14 03:18:02.411925 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 235/443] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:18:02 2021] GET /compute/v2.1/servers/095d132d-1529-4a41-a033-a8b41a1af328 => generated 1218 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:18:02.526993 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-a1723f90-86c4-4db4-86f4-c58d61ca729c tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:02.535558 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-a1723f90-86c4-4db4-86f4-c58d61ca729c tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef" status: 200 len: 1567 microversion: 2.1 time: 0.182077 Dec 14 03:18:02.536652 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 209/444] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:18:02 2021] GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef => generated 1567 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 03:18:02.663920 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-82f8818e-0834-4a0e-9ac5-c3aa82787560 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:18:02.665103 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-82f8818e-0834-4a0e-9ac5-c3aa82787560 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:02.671771 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-82f8818e-0834-4a0e-9ac5-c3aa82787560 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:02.672219 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-82f8818e-0834-4a0e-9ac5-c3aa82787560 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:02.673485 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-82f8818e-0834-4a0e-9ac5-c3aa82787560 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:02.674224 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-82f8818e-0834-4a0e-9ac5-c3aa82787560 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:02.767272 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-d70c77e7-f9e0-4583-8db8-58e5ab112191 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:18:02.768251 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-d70c77e7-f9e0-4583-8db8-58e5ab112191 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:02.774956 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-d70c77e7-f9e0-4583-8db8-58e5ab112191 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:02.775445 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-d70c77e7-f9e0-4583-8db8-58e5ab112191 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:02.776232 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-d70c77e7-f9e0-4583-8db8-58e5ab112191 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:02.776675 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-d70c77e7-f9e0-4583-8db8-58e5ab112191 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:02.777976 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-82f8818e-0834-4a0e-9ac5-c3aa82787560 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action" status: 200 len: 29261 microversion: 2.20 time: 0.117914 Dec 14 03:18:02.779469 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 236/445] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:18:02 2021] POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action => generated 29261 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:18:02.896750 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-d70c77e7-f9e0-4583-8db8-58e5ab112191 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action" status: 200 len: 28598 microversion: 2.1 time: 0.133427 Dec 14 03:18:02.897417 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 210/446] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:18:02 2021] POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action => generated 28598 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 14 03:18:03.428136 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-661876e5-f24f-44e4-a32e-f70534296b9a tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:03.428872 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-661876e5-f24f-44e4-a32e-f70534296b9a tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: 095d132d-1529-4a41-a033-a8b41a1af328] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:03.435708 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-661876e5-f24f-44e4-a32e-f70534296b9a tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:03.436167 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-661876e5-f24f-44e4-a32e-f70534296b9a tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:03.436944 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-661876e5-f24f-44e4-a32e-f70534296b9a tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:03.437382 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-661876e5-f24f-44e4-a32e-f70534296b9a tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:03.497153 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-661876e5-f24f-44e4-a32e-f70534296b9a tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:03.505244 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-661876e5-f24f-44e4-a32e-f70534296b9a tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/095d132d-1529-4a41-a033-a8b41a1af328" status: 200 len: 1270 microversion: 2.1 time: 0.081007 Dec 14 03:18:03.505805 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 237/447] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:18:03 2021] GET /compute/v2.1/servers/095d132d-1529-4a41-a033-a8b41a1af328 => generated 1270 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:18:03.553917 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-24d75af0-4236-4f7b-a603-47d0d02a2adc tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:03.554529 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-24d75af0-4236-4f7b-a603-47d0d02a2adc tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: 4687b559-c95a-4b82-a076-a7468c10ebef] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:03.561277 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-24d75af0-4236-4f7b-a603-47d0d02a2adc tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:03.561720 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-24d75af0-4236-4f7b-a603-47d0d02a2adc tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:03.562489 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-24d75af0-4236-4f7b-a603-47d0d02a2adc tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:03.562919 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-24d75af0-4236-4f7b-a603-47d0d02a2adc tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:03.693960 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-24d75af0-4236-4f7b-a603-47d0d02a2adc tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:03.702051 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-24d75af0-4236-4f7b-a603-47d0d02a2adc tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef" status: 200 len: 1567 microversion: 2.1 time: 0.152177 Dec 14 03:18:03.702593 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 211/448] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:18:03 2021] GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:18:03.789204 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-42a4ab69-8b40-4374-8f63-0163ca958af9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:18:03.790127 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-42a4ab69-8b40-4374-8f63-0163ca958af9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:03.796347 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-42a4ab69-8b40-4374-8f63-0163ca958af9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:03.796800 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-42a4ab69-8b40-4374-8f63-0163ca958af9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:03.797858 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-42a4ab69-8b40-4374-8f63-0163ca958af9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:03.798927 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-42a4ab69-8b40-4374-8f63-0163ca958af9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:03.900064 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-42a4ab69-8b40-4374-8f63-0163ca958af9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action" status: 200 len: 29261 microversion: 2.20 time: 0.114301 Dec 14 03:18:03.900713 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 238/449] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:18:03 2021] POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action => generated 29261 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:18:03.910139 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-0ea6d97a-b3d2-494c-993c-c716414d770f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:18:03.912283 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-0ea6d97a-b3d2-494c-993c-c716414d770f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:03.931856 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-0ea6d97a-b3d2-494c-993c-c716414d770f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:03.932501 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-0ea6d97a-b3d2-494c-993c-c716414d770f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:03.933401 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-0ea6d97a-b3d2-494c-993c-c716414d770f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:03.933946 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-0ea6d97a-b3d2-494c-993c-c716414d770f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:04.085260 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-0ea6d97a-b3d2-494c-993c-c716414d770f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action" status: 200 len: 28598 microversion: 2.1 time: 0.179655 Dec 14 03:18:04.085888 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 212/450] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:18:03 2021] POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action => generated 28598 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:18:04.522735 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-3772d8a9-8b65-42d0-8da7-a1b1aa3c877e tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:04.523760 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-3772d8a9-8b65-42d0-8da7-a1b1aa3c877e tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: 095d132d-1529-4a41-a033-a8b41a1af328] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:04.531083 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3772d8a9-8b65-42d0-8da7-a1b1aa3c877e tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:04.531543 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3772d8a9-8b65-42d0-8da7-a1b1aa3c877e tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:04.532929 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3772d8a9-8b65-42d0-8da7-a1b1aa3c877e tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:04.533462 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3772d8a9-8b65-42d0-8da7-a1b1aa3c877e tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:04.611249 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-3772d8a9-8b65-42d0-8da7-a1b1aa3c877e tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:04.618789 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-3772d8a9-8b65-42d0-8da7-a1b1aa3c877e tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/095d132d-1529-4a41-a033-a8b41a1af328" status: 200 len: 1276 microversion: 2.1 time: 0.100128 Dec 14 03:18:04.619369 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 239/451] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:18:04 2021] GET /compute/v2.1/servers/095d132d-1529-4a41-a033-a8b41a1af328 => generated 1276 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:18:04.721957 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-51bc9167-acd1-4e8e-ae44-df069c671787 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:04.723409 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-51bc9167-acd1-4e8e-ae44-df069c671787 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: 4687b559-c95a-4b82-a076-a7468c10ebef] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:04.730965 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-51bc9167-acd1-4e8e-ae44-df069c671787 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:04.731489 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-51bc9167-acd1-4e8e-ae44-df069c671787 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:04.732514 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-51bc9167-acd1-4e8e-ae44-df069c671787 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:04.732956 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-51bc9167-acd1-4e8e-ae44-df069c671787 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:04.912612 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-3ed19d1f-aa14-44ba-9fd4-809688da71e8 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:18:04.914153 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-3ed19d1f-aa14-44ba-9fd4-809688da71e8 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:04.920815 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3ed19d1f-aa14-44ba-9fd4-809688da71e8 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:04.921254 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3ed19d1f-aa14-44ba-9fd4-809688da71e8 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:04.922539 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3ed19d1f-aa14-44ba-9fd4-809688da71e8 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:04.923004 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3ed19d1f-aa14-44ba-9fd4-809688da71e8 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:04.988621 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-51bc9167-acd1-4e8e-ae44-df069c671787 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:04.998025 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-51bc9167-acd1-4e8e-ae44-df069c671787 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef" status: 200 len: 1567 microversion: 2.1 time: 0.282749 Dec 14 03:18:05.008026 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 213/452] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:18:04 2021] GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef => generated 1567 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:18:05.042182 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-3ed19d1f-aa14-44ba-9fd4-809688da71e8 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action" status: 200 len: 29261 microversion: 2.20 time: 0.132905 Dec 14 03:18:05.042754 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 240/453] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:18:04 2021] POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action => generated 29261 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 14 03:18:05.097999 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-150cd5bd-4583-419b-a5cb-94aba7b01f29 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:18:05.101335 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-150cd5bd-4583-419b-a5cb-94aba7b01f29 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:05.105548 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-150cd5bd-4583-419b-a5cb-94aba7b01f29 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:05.106002 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-150cd5bd-4583-419b-a5cb-94aba7b01f29 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:05.106795 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-150cd5bd-4583-419b-a5cb-94aba7b01f29 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:05.107258 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-150cd5bd-4583-419b-a5cb-94aba7b01f29 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:05.221813 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-150cd5bd-4583-419b-a5cb-94aba7b01f29 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action" status: 200 len: 28598 microversion: 2.1 time: 0.128088 Dec 14 03:18:05.225728 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 214/454] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:18:05 2021] POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action => generated 28598 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:18:05.440676 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [req-9cdae27d-3bab-46c8-86d3-b8598d404b38 req-9a3ecc03-bc68-4f4d-9e27-65718917e7ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "095d132d-1529-4a41-a033-a8b41a1af328", "tag": "fa30f5e8-3d02-4477-a5a9-b31ae00e7c7b"}]} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:18:05.442237 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:18:05.442237 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: warnings.warn(msg) Dec 14 03:18:05.450447 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-9cdae27d-3bab-46c8-86d3-b8598d404b38 req-9a3ecc03-bc68-4f4d-9e27-65718917e7ed service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:05.451072 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-9cdae27d-3bab-46c8-86d3-b8598d404b38 req-9a3ecc03-bc68-4f4d-9e27-65718917e7ed service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:05.463003 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.compute.server_external_events [req-9cdae27d-3bab-46c8-86d3-b8598d404b38 req-9a3ecc03-bc68-4f4d-9e27-65718917e7ed service nova] Creating event network-changed:fa30f5e8-3d02-4477-a5a9-b31ae00e7c7b for instance 095d132d-1529-4a41-a033-a8b41a1af328 on hv-cinder-81803 Dec 14 03:18:05.467569 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [req-9cdae27d-3bab-46c8-86d3-b8598d404b38 req-9a3ecc03-bc68-4f4d-9e27-65718917e7ed service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031466 Dec 14 03:18:05.468145 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 241/455] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Dec 14 03:18:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:18:05.636105 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-d6634af6-1225-47fa-a04c-882452ca7f67 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:05.636808 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-d6634af6-1225-47fa-a04c-882452ca7f67 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: 095d132d-1529-4a41-a033-a8b41a1af328] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:05.644884 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-d6634af6-1225-47fa-a04c-882452ca7f67 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:05.645342 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-d6634af6-1225-47fa-a04c-882452ca7f67 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:05.646143 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-d6634af6-1225-47fa-a04c-882452ca7f67 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:05.646589 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-d6634af6-1225-47fa-a04c-882452ca7f67 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:05.858925 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-d6634af6-1225-47fa-a04c-882452ca7f67 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:05.867008 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-d6634af6-1225-47fa-a04c-882452ca7f67 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/095d132d-1529-4a41-a033-a8b41a1af328" status: 200 len: 1318 microversion: 2.1 time: 0.234878 Dec 14 03:18:05.867617 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 215/456] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:18:05 2021] GET /compute/v2.1/servers/095d132d-1529-4a41-a033-a8b41a1af328 => generated 1318 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:18:06.015820 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-9b650537-2ce1-433f-87b1-06ec8e99ec1a tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:06.016578 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-9b650537-2ce1-433f-87b1-06ec8e99ec1a tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: 4687b559-c95a-4b82-a076-a7468c10ebef] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:06.024245 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9b650537-2ce1-433f-87b1-06ec8e99ec1a tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:06.024686 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9b650537-2ce1-433f-87b1-06ec8e99ec1a tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:06.025463 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9b650537-2ce1-433f-87b1-06ec8e99ec1a tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:06.025897 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9b650537-2ce1-433f-87b1-06ec8e99ec1a tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:06.054565 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-70894566-c32d-403a-9eab-bd76b7237049 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:18:06.055688 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-70894566-c32d-403a-9eab-bd76b7237049 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:06.061917 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-70894566-c32d-403a-9eab-bd76b7237049 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:06.062369 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-70894566-c32d-403a-9eab-bd76b7237049 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:06.063182 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-70894566-c32d-403a-9eab-bd76b7237049 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:06.063625 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-70894566-c32d-403a-9eab-bd76b7237049 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:06.163403 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-70894566-c32d-403a-9eab-bd76b7237049 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action" status: 200 len: 29261 microversion: 2.20 time: 0.112445 Dec 14 03:18:06.167450 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 216/457] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:18:06 2021] POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action => generated 29261 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 14 03:18:06.233197 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-9b650537-2ce1-433f-87b1-06ec8e99ec1a tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:06.234137 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-b6ae37f8-7990-4d72-9ab1-05fad196457d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:18:06.235261 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-b6ae37f8-7990-4d72-9ab1-05fad196457d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:06.241300 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-9b650537-2ce1-433f-87b1-06ec8e99ec1a tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef" status: 200 len: 1567 microversion: 2.1 time: 0.229976 Dec 14 03:18:06.242027 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 242/458] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:18:06 2021] GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef => generated 1567 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:18:06.244771 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b6ae37f8-7990-4d72-9ab1-05fad196457d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:06.245256 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b6ae37f8-7990-4d72-9ab1-05fad196457d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:06.246728 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b6ae37f8-7990-4d72-9ab1-05fad196457d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:06.247215 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b6ae37f8-7990-4d72-9ab1-05fad196457d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:06.572943 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-b6ae37f8-7990-4d72-9ab1-05fad196457d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action" status: 200 len: 28598 microversion: 2.1 time: 0.342829 Dec 14 03:18:06.576916 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 217/459] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:18:06 2021] POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action => generated 28598 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 14 03:18:06.884324 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-2163015e-ea7c-4695-b77b-1bb0a97b0051 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:06.884943 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-2163015e-ea7c-4695-b77b-1bb0a97b0051 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: 095d132d-1529-4a41-a033-a8b41a1af328] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:06.891509 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2163015e-ea7c-4695-b77b-1bb0a97b0051 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:06.891958 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2163015e-ea7c-4695-b77b-1bb0a97b0051 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:06.892744 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2163015e-ea7c-4695-b77b-1bb0a97b0051 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:06.893190 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2163015e-ea7c-4695-b77b-1bb0a97b0051 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:07.027232 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-2163015e-ea7c-4695-b77b-1bb0a97b0051 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:07.035054 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-2163015e-ea7c-4695-b77b-1bb0a97b0051 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/095d132d-1529-4a41-a033-a8b41a1af328" status: 200 len: 1318 microversion: 2.1 time: 0.154428 Dec 14 03:18:07.035623 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 243/460] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:18:06 2021] GET /compute/v2.1/servers/095d132d-1529-4a41-a033-a8b41a1af328 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:18:07.176508 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-956b178e-10bb-40d1-b791-b22dc1ade819 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:18:07.177507 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-956b178e-10bb-40d1-b791-b22dc1ade819 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:07.184739 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-956b178e-10bb-40d1-b791-b22dc1ade819 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:07.185180 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-956b178e-10bb-40d1-b791-b22dc1ade819 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:07.185967 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-956b178e-10bb-40d1-b791-b22dc1ade819 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:07.186402 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-956b178e-10bb-40d1-b791-b22dc1ade819 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:07.258890 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-c6134c7b-8937-4e5e-9f7a-f0fef4f31570 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:07.259451 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-c6134c7b-8937-4e5e-9f7a-f0fef4f31570 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: 4687b559-c95a-4b82-a076-a7468c10ebef] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:07.265613 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c6134c7b-8937-4e5e-9f7a-f0fef4f31570 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:07.266061 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c6134c7b-8937-4e5e-9f7a-f0fef4f31570 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:07.267019 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c6134c7b-8937-4e5e-9f7a-f0fef4f31570 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:07.267481 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c6134c7b-8937-4e5e-9f7a-f0fef4f31570 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:07.329633 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-956b178e-10bb-40d1-b791-b22dc1ade819 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action" status: 200 len: 29261 microversion: 2.20 time: 0.157671 Dec 14 03:18:07.331337 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 218/461] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:18:07 2021] POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action => generated 29261 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 14 03:18:07.399716 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-c6134c7b-8937-4e5e-9f7a-f0fef4f31570 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:07.407948 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-c6134c7b-8937-4e5e-9f7a-f0fef4f31570 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef" status: 200 len: 1567 microversion: 2.1 time: 0.152745 Dec 14 03:18:07.408513 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 244/462] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:18:07 2021] GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 03:18:07.585613 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-0fb5937f-66b2-4b40-a6d8-acf06b216636 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:18:07.586715 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-0fb5937f-66b2-4b40-a6d8-acf06b216636 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:07.593876 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-0fb5937f-66b2-4b40-a6d8-acf06b216636 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:07.594328 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-0fb5937f-66b2-4b40-a6d8-acf06b216636 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:07.595133 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-0fb5937f-66b2-4b40-a6d8-acf06b216636 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:07.595576 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-0fb5937f-66b2-4b40-a6d8-acf06b216636 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:07.864153 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-0fb5937f-66b2-4b40-a6d8-acf06b216636 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action" status: 200 len: 28598 microversion: 2.1 time: 0.282447 Dec 14 03:18:07.865013 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 219/463] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:18:07 2021] POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action => generated 28598 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:18:08.052542 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-cff98b77-ac77-4267-8668-bd2effe5906f tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:08.053172 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-cff98b77-ac77-4267-8668-bd2effe5906f tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: 095d132d-1529-4a41-a033-a8b41a1af328] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:08.059500 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-cff98b77-ac77-4267-8668-bd2effe5906f tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:08.059943 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-cff98b77-ac77-4267-8668-bd2effe5906f tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:08.060726 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-cff98b77-ac77-4267-8668-bd2effe5906f tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:08.061154 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-cff98b77-ac77-4267-8668-bd2effe5906f tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:08.191905 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-cff98b77-ac77-4267-8668-bd2effe5906f tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:08.199023 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-cff98b77-ac77-4267-8668-bd2effe5906f tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/095d132d-1529-4a41-a033-a8b41a1af328" status: 200 len: 1318 microversion: 2.1 time: 0.150280 Dec 14 03:18:08.199606 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 245/464] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:18:08 2021] GET /compute/v2.1/servers/095d132d-1529-4a41-a033-a8b41a1af328 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:18:08.342088 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-809f86e7-6fdb-40d7-9a2a-cb5606dcc111 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:18:08.343118 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-809f86e7-6fdb-40d7-9a2a-cb5606dcc111 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:08.350412 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-809f86e7-6fdb-40d7-9a2a-cb5606dcc111 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:08.350867 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-809f86e7-6fdb-40d7-9a2a-cb5606dcc111 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:08.351682 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-809f86e7-6fdb-40d7-9a2a-cb5606dcc111 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:08.352123 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-809f86e7-6fdb-40d7-9a2a-cb5606dcc111 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:08.425104 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-045f6be0-6450-4d86-906a-8a85c59a82e2 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:08.425630 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-045f6be0-6450-4d86-906a-8a85c59a82e2 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: 4687b559-c95a-4b82-a076-a7468c10ebef] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:08.431573 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-045f6be0-6450-4d86-906a-8a85c59a82e2 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:08.432032 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-045f6be0-6450-4d86-906a-8a85c59a82e2 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:08.432819 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-045f6be0-6450-4d86-906a-8a85c59a82e2 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:08.433244 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-045f6be0-6450-4d86-906a-8a85c59a82e2 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:08.454443 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-809f86e7-6fdb-40d7-9a2a-cb5606dcc111 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action" status: 200 len: 29261 microversion: 2.20 time: 0.116242 Dec 14 03:18:08.455339 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 220/465] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:18:08 2021] POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action => generated 29261 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:18:08.567001 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-045f6be0-6450-4d86-906a-8a85c59a82e2 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:08.575103 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-045f6be0-6450-4d86-906a-8a85c59a82e2 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef" status: 200 len: 1567 microversion: 2.1 time: 0.154354 Dec 14 03:18:08.576237 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 246/466] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:18:08 2021] GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:18:08.876942 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-e85ff46b-e136-4192-8b9d-e0152fc38440 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:18:08.878050 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-e85ff46b-e136-4192-8b9d-e0152fc38440 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:08.885039 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-e85ff46b-e136-4192-8b9d-e0152fc38440 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:08.885537 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-e85ff46b-e136-4192-8b9d-e0152fc38440 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:08.886360 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-e85ff46b-e136-4192-8b9d-e0152fc38440 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:08.886802 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-e85ff46b-e136-4192-8b9d-e0152fc38440 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:08.991955 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-e85ff46b-e136-4192-8b9d-e0152fc38440 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action" status: 200 len: 28598 microversion: 2.1 time: 0.119490 Dec 14 03:18:08.992458 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 221/467] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:18:08 2021] POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action => generated 28598 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:18:09.053557 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-84ee6906-0851-4960-b88b-dfd19850c030 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:09.054200 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-84ee6906-0851-4960-b88b-dfd19850c030 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] [instance: cfd2456c-8f28-4be0-9c97-8e03b0fec041] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:09.060646 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-84ee6906-0851-4960-b88b-dfd19850c030 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:09.061099 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-84ee6906-0851-4960-b88b-dfd19850c030 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:09.061918 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-84ee6906-0851-4960-b88b-dfd19850c030 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:09.062401 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-84ee6906-0851-4960-b88b-dfd19850c030 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:09.192714 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-84ee6906-0851-4960-b88b-dfd19850c030 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d620fa9da54f588f753b3c497f00c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:09.200475 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-84ee6906-0851-4960-b88b-dfd19850c030 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041" status: 200 len: 1595 microversion: 2.1 time: 0.150496 Dec 14 03:18:09.201041 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 247/468] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:18:09 2021] GET /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041 => generated 1595 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:18:09.216176 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-677dbf40-d04c-4509-a3b1-b9689fde3d6a tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:09.216881 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-677dbf40-d04c-4509-a3b1-b9689fde3d6a tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: 095d132d-1529-4a41-a033-a8b41a1af328] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:09.223255 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-677dbf40-d04c-4509-a3b1-b9689fde3d6a tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:09.223705 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-677dbf40-d04c-4509-a3b1-b9689fde3d6a tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:09.224715 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-677dbf40-d04c-4509-a3b1-b9689fde3d6a tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:09.225213 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-677dbf40-d04c-4509-a3b1-b9689fde3d6a tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:09.379628 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-677dbf40-d04c-4509-a3b1-b9689fde3d6a tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:09.388267 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-677dbf40-d04c-4509-a3b1-b9689fde3d6a tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/095d132d-1529-4a41-a033-a8b41a1af328" status: 200 len: 1318 microversion: 2.1 time: 0.175868 Dec 14 03:18:09.388960 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 222/469] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:18:09 2021] GET /compute/v2.1/servers/095d132d-1529-4a41-a033-a8b41a1af328 => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:18:09.465969 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-5219c453-9c3c-463a-b473-1a0d740095e3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:18:09.467063 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-5219c453-9c3c-463a-b473-1a0d740095e3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:09.472983 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5219c453-9c3c-463a-b473-1a0d740095e3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:09.473509 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5219c453-9c3c-463a-b473-1a0d740095e3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:09.474375 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5219c453-9c3c-463a-b473-1a0d740095e3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:09.474880 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5219c453-9c3c-463a-b473-1a0d740095e3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:09.576132 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-5219c453-9c3c-463a-b473-1a0d740095e3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action" status: 200 len: 29261 microversion: 2.20 time: 0.113744 Dec 14 03:18:09.576944 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 248/470] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:18:09 2021] POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action => generated 29261 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:18:09.592939 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-91cbdb46-4abc-414c-8c56-7ef25c685f79 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:09.593559 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-91cbdb46-4abc-414c-8c56-7ef25c685f79 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: 4687b559-c95a-4b82-a076-a7468c10ebef] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:09.599848 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-91cbdb46-4abc-414c-8c56-7ef25c685f79 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:09.600305 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-91cbdb46-4abc-414c-8c56-7ef25c685f79 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:09.601098 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-91cbdb46-4abc-414c-8c56-7ef25c685f79 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:09.601551 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-91cbdb46-4abc-414c-8c56-7ef25c685f79 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:09.745927 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-91cbdb46-4abc-414c-8c56-7ef25c685f79 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:09.753774 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-91cbdb46-4abc-414c-8c56-7ef25c685f79 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef" status: 200 len: 1567 microversion: 2.1 time: 0.164544 Dec 14 03:18:09.754335 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 223/471] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:18:09 2021] GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:18:10.004324 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-4fef6abe-85fd-4817-997c-67366d64fbd3 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:18:10.005486 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-4fef6abe-85fd-4817-997c-67366d64fbd3 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:10.012592 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4fef6abe-85fd-4817-997c-67366d64fbd3 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:10.013154 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4fef6abe-85fd-4817-997c-67366d64fbd3 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:10.014025 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4fef6abe-85fd-4817-997c-67366d64fbd3 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:10.014535 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4fef6abe-85fd-4817-997c-67366d64fbd3 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:10.117080 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-4fef6abe-85fd-4817-997c-67366d64fbd3 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action" status: 200 len: 28598 microversion: 2.1 time: 0.117515 Dec 14 03:18:10.117755 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 249/472] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:18:09 2021] POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action => generated 28598 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:18:10.405211 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-da096e6f-1077-4f10-89c8-0e2311ec591b tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:10.405942 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-da096e6f-1077-4f10-89c8-0e2311ec591b tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: 095d132d-1529-4a41-a033-a8b41a1af328] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:10.413171 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-da096e6f-1077-4f10-89c8-0e2311ec591b tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:10.413625 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-da096e6f-1077-4f10-89c8-0e2311ec591b tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:10.414440 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-da096e6f-1077-4f10-89c8-0e2311ec591b tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:10.414884 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-da096e6f-1077-4f10-89c8-0e2311ec591b tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:10.550843 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-da096e6f-1077-4f10-89c8-0e2311ec591b tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:10.559387 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-da096e6f-1077-4f10-89c8-0e2311ec591b tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/095d132d-1529-4a41-a033-a8b41a1af328" status: 200 len: 1318 microversion: 2.1 time: 0.157766 Dec 14 03:18:10.567711 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 224/473] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:18:10 2021] GET /compute/v2.1/servers/095d132d-1529-4a41-a033-a8b41a1af328 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:18:10.589351 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-f3e62b01-442f-41d1-9f5d-22ffa52ba6cf tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:18:10.590853 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-f3e62b01-442f-41d1-9f5d-22ffa52ba6cf tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:10.599309 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f3e62b01-442f-41d1-9f5d-22ffa52ba6cf tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:10.599754 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f3e62b01-442f-41d1-9f5d-22ffa52ba6cf tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:10.600708 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f3e62b01-442f-41d1-9f5d-22ffa52ba6cf tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:10.601140 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f3e62b01-442f-41d1-9f5d-22ffa52ba6cf tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:10.711792 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-f3e62b01-442f-41d1-9f5d-22ffa52ba6cf tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action" status: 200 len: 29261 microversion: 2.20 time: 0.127160 Dec 14 03:18:10.712829 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 250/474] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:18:10 2021] POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action => generated 29261 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 14 03:18:10.771636 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-eb1fb49c-8928-4f1a-b81f-07cbc8c09084 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:10.772245 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-eb1fb49c-8928-4f1a-b81f-07cbc8c09084 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: 4687b559-c95a-4b82-a076-a7468c10ebef] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:10.777859 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-eb1fb49c-8928-4f1a-b81f-07cbc8c09084 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:10.778308 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-eb1fb49c-8928-4f1a-b81f-07cbc8c09084 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:10.779101 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-eb1fb49c-8928-4f1a-b81f-07cbc8c09084 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:10.779537 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-eb1fb49c-8928-4f1a-b81f-07cbc8c09084 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:10.889481 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 14 03:18:10.889721 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: Tue Dec 14 03:18:10 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef (ip 10.222.0.43) !!! Dec 14 03:18:10.908560 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-eb1fb49c-8928-4f1a-b81f-07cbc8c09084 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:10.916569 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-eb1fb49c-8928-4f1a-b81f-07cbc8c09084 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef" status: 200 len: 1567 microversion: 2.1 time: 0.148544 Dec 14 03:18:10.917243 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 225/475] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:18:10 2021] GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:18:11.008086 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [req-1df10572-e8ae-44b2-9dd4-39f7a2d1c42e req-c2451088-0761-4bba-a99c-a0bbae6b812b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfd2456c-8f28-4be0-9c97-8e03b0fec041", "tag": "bb3c28d2-c03d-4924-8dd8-da975e5427e4"}]} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:18:11.009867 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:18:11.009867 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: warnings.warn(msg) Dec 14 03:18:11.018614 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-1df10572-e8ae-44b2-9dd4-39f7a2d1c42e req-c2451088-0761-4bba-a99c-a0bbae6b812b service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:11.019195 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-1df10572-e8ae-44b2-9dd4-39f7a2d1c42e req-c2451088-0761-4bba-a99c-a0bbae6b812b service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:11.040680 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.compute.server_external_events [req-1df10572-e8ae-44b2-9dd4-39f7a2d1c42e req-c2451088-0761-4bba-a99c-a0bbae6b812b service nova] Creating event network-changed:bb3c28d2-c03d-4924-8dd8-da975e5427e4 for instance cfd2456c-8f28-4be0-9c97-8e03b0fec041 on hv-cinder-81803 Dec 14 03:18:11.046062 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [req-1df10572-e8ae-44b2-9dd4-39f7a2d1c42e req-c2451088-0761-4bba-a99c-a0bbae6b812b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042564 Dec 14 03:18:11.047000 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 251/476] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Dec 14 03:18:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:18:11.130072 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-2cc5638c-918c-40c4-9ca8-46b09387c263 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:18:11.131279 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-2cc5638c-918c-40c4-9ca8-46b09387c263 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:11.138348 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-2cc5638c-918c-40c4-9ca8-46b09387c263 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:11.138903 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-2cc5638c-918c-40c4-9ca8-46b09387c263 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:11.139910 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-2cc5638c-918c-40c4-9ca8-46b09387c263 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:11.140410 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-2cc5638c-918c-40c4-9ca8-46b09387c263 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:11.252842 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-2cc5638c-918c-40c4-9ca8-46b09387c263 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action" status: 200 len: 28598 microversion: 2.1 time: 0.127380 Dec 14 03:18:11.253490 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 226/477] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:18:11 2021] POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action => generated 28598 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 14 03:18:11.577013 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-cfd1bbad-28c2-4518-b23f-168b9d3c6840 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:11.577925 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-cfd1bbad-28c2-4518-b23f-168b9d3c6840 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: 095d132d-1529-4a41-a033-a8b41a1af328] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:11.586510 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-cfd1bbad-28c2-4518-b23f-168b9d3c6840 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:11.587719 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-cfd1bbad-28c2-4518-b23f-168b9d3c6840 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:11.588862 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-cfd1bbad-28c2-4518-b23f-168b9d3c6840 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:11.589677 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-cfd1bbad-28c2-4518-b23f-168b9d3c6840 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:11.730035 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-a704ae6c-407c-4688-a41c-399ed1321cc3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:18:11.732499 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-a704ae6c-407c-4688-a41c-399ed1321cc3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:11.741342 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a704ae6c-407c-4688-a41c-399ed1321cc3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:11.742045 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a704ae6c-407c-4688-a41c-399ed1321cc3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:11.743068 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a704ae6c-407c-4688-a41c-399ed1321cc3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:11.743752 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a704ae6c-407c-4688-a41c-399ed1321cc3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:11.839984 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-cfd1bbad-28c2-4518-b23f-168b9d3c6840 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:11.841362 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-a704ae6c-407c-4688-a41c-399ed1321cc3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action" status: 200 len: 29261 microversion: 2.20 time: 0.121121 Dec 14 03:18:11.846132 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 227/478] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:18:11 2021] POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action => generated 29261 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 14 03:18:11.853609 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-cfd1bbad-28c2-4518-b23f-168b9d3c6840 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/095d132d-1529-4a41-a033-a8b41a1af328" status: 200 len: 1318 microversion: 2.1 time: 0.280764 Dec 14 03:18:11.854194 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 252/479] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:18:11 2021] GET /compute/v2.1/servers/095d132d-1529-4a41-a033-a8b41a1af328 => generated 1318 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 03:18:11.944576 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-652f1575-5646-40cd-bf1d-55c8598b9059 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:11.945560 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-652f1575-5646-40cd-bf1d-55c8598b9059 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: 4687b559-c95a-4b82-a076-a7468c10ebef] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:11.954286 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-652f1575-5646-40cd-bf1d-55c8598b9059 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:11.956344 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-652f1575-5646-40cd-bf1d-55c8598b9059 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:11.958750 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-652f1575-5646-40cd-bf1d-55c8598b9059 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:11.959443 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-652f1575-5646-40cd-bf1d-55c8598b9059 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:12.129576 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-652f1575-5646-40cd-bf1d-55c8598b9059 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:12.139324 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-652f1575-5646-40cd-bf1d-55c8598b9059 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef" status: 200 len: 1567 microversion: 2.1 time: 0.209042 Dec 14 03:18:12.140325 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 228/480] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:18:11 2021] GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef => generated 1567 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:18:12.250129 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-9b78de4a-3b9d-445c-8909-7f9b962ba846 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-309499008"}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:18:12.250672 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-9b78de4a-3b9d-445c-8909-7f9b962ba846 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] [instance: cfd2456c-8f28-4be0-9c97-8e03b0fec041] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:12.256972 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9b78de4a-3b9d-445c-8909-7f9b962ba846 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:12.257424 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9b78de4a-3b9d-445c-8909-7f9b962ba846 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:12.258238 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9b78de4a-3b9d-445c-8909-7f9b962ba846 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:12.258673 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9b78de4a-3b9d-445c-8909-7f9b962ba846 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:12.264476 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-f43ee95b-9c30-4bc3-8c2c-7cd7771a529f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:18:12.265402 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-f43ee95b-9c30-4bc3-8c2c-7cd7771a529f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:12.272823 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-f43ee95b-9c30-4bc3-8c2c-7cd7771a529f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:12.273285 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-f43ee95b-9c30-4bc3-8c2c-7cd7771a529f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:12.274310 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-f43ee95b-9c30-4bc3-8c2c-7cd7771a529f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:12.274918 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-f43ee95b-9c30-4bc3-8c2c-7cd7771a529f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:12.385742 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-f43ee95b-9c30-4bc3-8c2c-7cd7771a529f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action" status: 200 len: 28950 microversion: 2.1 time: 0.124373 Dec 14 03:18:12.387238 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 229/481] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:18:12 2021] POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action => generated 28950 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 14 03:18:12.388855 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.network.security_group_api [None req-9b78de4a-3b9d-445c-8909-7f9b962ba846 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Adding security group fa44b3d3-acb1-44ee-af7e-bffca3aa686e to port bb3c28d2-c03d-4924-8dd8-da975e5427e4 Dec 14 03:18:12.766137 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-9b78de4a-3b9d-445c-8909-7f9b962ba846 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "POST /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041/action" status: 202 len: 0 microversion: 2.1 time: 0.519582 Dec 14 03:18:12.768296 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 253/482] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:18:12 2021] POST /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041/action => generated 0 bytes in 522 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:18:12.776437 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-69dd2ed4-1d15-436f-b609-57249ec4e96c tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:12.778000 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-69dd2ed4-1d15-436f-b609-57249ec4e96c tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] [instance: cfd2456c-8f28-4be0-9c97-8e03b0fec041] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:12.784757 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [req-7017c513-52b7-4c0b-bf0a-4bed8dd14860 req-4a12713a-b2cd-46d9-a791-2aba12dc6ed6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfd2456c-8f28-4be0-9c97-8e03b0fec041", "tag": "bb3c28d2-c03d-4924-8dd8-da975e5427e4"}]} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:18:12.785401 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-69dd2ed4-1d15-436f-b609-57249ec4e96c tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:12.786030 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-69dd2ed4-1d15-436f-b609-57249ec4e96c tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:12.788670 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:18:12.788670 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: warnings.warn(msg) Dec 14 03:18:12.791494 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-69dd2ed4-1d15-436f-b609-57249ec4e96c tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:12.792146 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-69dd2ed4-1d15-436f-b609-57249ec4e96c tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:12.801747 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-7017c513-52b7-4c0b-bf0a-4bed8dd14860 req-4a12713a-b2cd-46d9-a791-2aba12dc6ed6 service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:12.802206 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-7017c513-52b7-4c0b-bf0a-4bed8dd14860 req-4a12713a-b2cd-46d9-a791-2aba12dc6ed6 service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:12.815714 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.compute.server_external_events [req-7017c513-52b7-4c0b-bf0a-4bed8dd14860 req-4a12713a-b2cd-46d9-a791-2aba12dc6ed6 service nova] Creating event network-changed:bb3c28d2-c03d-4924-8dd8-da975e5427e4 for instance cfd2456c-8f28-4be0-9c97-8e03b0fec041 on hv-cinder-81803 Dec 14 03:18:12.821766 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [req-7017c513-52b7-4c0b-bf0a-4bed8dd14860 req-4a12713a-b2cd-46d9-a791-2aba12dc6ed6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043591 Dec 14 03:18:12.822689 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 254/483] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Dec 14 03:18:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:18:12.854557 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-90fbe7fd-f491-4b65-b1e1-003b36b0f1b9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:18:12.856576 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-90fbe7fd-f491-4b65-b1e1-003b36b0f1b9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:12.864105 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-90fbe7fd-f491-4b65-b1e1-003b36b0f1b9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:12.864949 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-90fbe7fd-f491-4b65-b1e1-003b36b0f1b9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:12.865893 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-90fbe7fd-f491-4b65-b1e1-003b36b0f1b9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:12.866768 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-90fbe7fd-f491-4b65-b1e1-003b36b0f1b9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:12.985729 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-90fbe7fd-f491-4b65-b1e1-003b36b0f1b9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action" status: 200 len: 29638 microversion: 2.20 time: 0.134710 Dec 14 03:18:12.988344 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 255/484] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:18:12 2021] POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action => generated 29638 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 14 03:18:12.995819 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-d777ccee-e184-43f6-8ede-e9eb9407513e tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:12.996733 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-d777ccee-e184-43f6-8ede-e9eb9407513e tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: 095d132d-1529-4a41-a033-a8b41a1af328] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:13.004243 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d777ccee-e184-43f6-8ede-e9eb9407513e tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:13.004698 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d777ccee-e184-43f6-8ede-e9eb9407513e tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:13.005667 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d777ccee-e184-43f6-8ede-e9eb9407513e tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:13.006107 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d777ccee-e184-43f6-8ede-e9eb9407513e tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:13.030856 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-69dd2ed4-1d15-436f-b609-57249ec4e96c tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d620fa9da54f588f753b3c497f00c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:13.041130 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-69dd2ed4-1d15-436f-b609-57249ec4e96c tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041" status: 200 len: 1760 microversion: 2.1 time: 0.268590 Dec 14 03:18:13.042727 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 230/485] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:18:12 2021] GET /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041 => generated 1760 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 03:18:13.156835 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-72279cdf-87a7-45ee-a2f9-543b6a85bd6b tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:13.158356 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-72279cdf-87a7-45ee-a2f9-543b6a85bd6b tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: 4687b559-c95a-4b82-a076-a7468c10ebef] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:13.165020 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-72279cdf-87a7-45ee-a2f9-543b6a85bd6b tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:13.166067 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-72279cdf-87a7-45ee-a2f9-543b6a85bd6b tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:13.167142 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-72279cdf-87a7-45ee-a2f9-543b6a85bd6b tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:13.167809 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-72279cdf-87a7-45ee-a2f9-543b6a85bd6b tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:13.277434 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-d777ccee-e184-43f6-8ede-e9eb9407513e tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:13.286323 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-d777ccee-e184-43f6-8ede-e9eb9407513e tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/095d132d-1529-4a41-a033-a8b41a1af328" status: 200 len: 1318 microversion: 2.1 time: 0.296387 Dec 14 03:18:13.286871 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 256/486] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:18:12 2021] GET /compute/v2.1/servers/095d132d-1529-4a41-a033-a8b41a1af328 => generated 1318 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:18:13.398196 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-87a41794-d73b-47ee-bd85-5608ccb18ce6 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:18:13.399805 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-87a41794-d73b-47ee-bd85-5608ccb18ce6 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:13.407462 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-87a41794-d73b-47ee-bd85-5608ccb18ce6 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:13.407921 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-87a41794-d73b-47ee-bd85-5608ccb18ce6 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:13.408727 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-87a41794-d73b-47ee-bd85-5608ccb18ce6 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:13.409192 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-87a41794-d73b-47ee-bd85-5608ccb18ce6 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:13.430323 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-72279cdf-87a7-45ee-a2f9-543b6a85bd6b tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:13.441841 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-72279cdf-87a7-45ee-a2f9-543b6a85bd6b tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef" status: 200 len: 1567 microversion: 2.1 time: 0.289010 Dec 14 03:18:13.442880 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 231/487] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:18:13 2021] GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef => generated 1567 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 03:18:13.545301 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-87a41794-d73b-47ee-bd85-5608ccb18ce6 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action" status: 200 len: 30254 microversion: 2.1 time: 0.150670 Dec 14 03:18:13.550037 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 257/488] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:18:13 2021] POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action => generated 30254 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 14 03:18:13.740830 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [req-6425f0c1-45b4-45e6-a220-31e5eea86f76 req-21e8cf43-2d3e-4c52-86dd-6a4cc2f86083 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "095d132d-1529-4a41-a033-a8b41a1af328", "name": "network-vif-plugged", "status": "completed", "tag": "fa30f5e8-3d02-4477-a5a9-b31ae00e7c7b"}]} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:18:13.743373 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:18:13.743373 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: warnings.warn(msg) Dec 14 03:18:13.752650 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [req-6425f0c1-45b4-45e6-a220-31e5eea86f76 req-21e8cf43-2d3e-4c52-86dd-6a4cc2f86083 service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:13.753193 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [req-6425f0c1-45b4-45e6-a220-31e5eea86f76 req-21e8cf43-2d3e-4c52-86dd-6a4cc2f86083 service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:13.769615 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.compute.server_external_events [req-6425f0c1-45b4-45e6-a220-31e5eea86f76 req-21e8cf43-2d3e-4c52-86dd-6a4cc2f86083 service nova] Creating event network-vif-plugged:fa30f5e8-3d02-4477-a5a9-b31ae00e7c7b for instance 095d132d-1529-4a41-a033-a8b41a1af328 on hv-cinder-81803 Dec 14 03:18:13.784056 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [req-6425f0c1-45b4-45e6-a220-31e5eea86f76 req-21e8cf43-2d3e-4c52-86dd-6a4cc2f86083 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040680 Dec 14 03:18:13.785608 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 232/489] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Dec 14 03:18:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:18:13.999455 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-8eecff01-03bd-4638-991f-c5316abd4d8e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:18:14.000464 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-8eecff01-03bd-4638-991f-c5316abd4d8e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:14.007313 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8eecff01-03bd-4638-991f-c5316abd4d8e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:14.007768 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8eecff01-03bd-4638-991f-c5316abd4d8e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:14.008558 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8eecff01-03bd-4638-991f-c5316abd4d8e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:14.008993 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8eecff01-03bd-4638-991f-c5316abd4d8e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:14.303359 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-e3577dd5-a116-4574-a97e-aae4b76dee1f tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:14.304076 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-e3577dd5-a116-4574-a97e-aae4b76dee1f tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: 095d132d-1529-4a41-a033-a8b41a1af328] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:14.312356 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-e3577dd5-a116-4574-a97e-aae4b76dee1f tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:14.312811 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-e3577dd5-a116-4574-a97e-aae4b76dee1f tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:14.314108 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-e3577dd5-a116-4574-a97e-aae4b76dee1f tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:14.314543 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-e3577dd5-a116-4574-a97e-aae4b76dee1f tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:14.446907 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-e3577dd5-a116-4574-a97e-aae4b76dee1f tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:14.458620 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-e3577dd5-a116-4574-a97e-aae4b76dee1f tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/095d132d-1529-4a41-a033-a8b41a1af328" status: 200 len: 1318 microversion: 2.1 time: 0.155164 Dec 14 03:18:14.458620 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 233/490] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:18:14 2021] GET /compute/v2.1/servers/095d132d-1529-4a41-a033-a8b41a1af328 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 03:18:14.461970 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-b1a24e9f-b897-4740-a6e3-3a62cd11a236 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:14.462583 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-b1a24e9f-b897-4740-a6e3-3a62cd11a236 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: 4687b559-c95a-4b82-a076-a7468c10ebef] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:14.468695 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b1a24e9f-b897-4740-a6e3-3a62cd11a236 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:14.469147 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b1a24e9f-b897-4740-a6e3-3a62cd11a236 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:14.469922 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b1a24e9f-b897-4740-a6e3-3a62cd11a236 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:14.470360 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b1a24e9f-b897-4740-a6e3-3a62cd11a236 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:14.604613 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-b1a24e9f-b897-4740-a6e3-3a62cd11a236 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:14.612808 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-b1a24e9f-b897-4740-a6e3-3a62cd11a236 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef" status: 200 len: 1567 microversion: 2.1 time: 0.155665 Dec 14 03:18:14.613620 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 234/491] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:18:14 2021] GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:18:14.617843 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-ca1eaa16-60eb-477f-841d-6bcb62437aca tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:18:14.618790 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-ca1eaa16-60eb-477f-841d-6bcb62437aca tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:14.624096 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ca1eaa16-60eb-477f-841d-6bcb62437aca tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:14.624544 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ca1eaa16-60eb-477f-841d-6bcb62437aca tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:14.625346 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ca1eaa16-60eb-477f-841d-6bcb62437aca tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:14.626378 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ca1eaa16-60eb-477f-841d-6bcb62437aca tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:14.668321 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-8eecff01-03bd-4638-991f-c5316abd4d8e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action" status: 200 len: 32267 microversion: 2.20 time: 0.672815 Dec 14 03:18:14.673404 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 258/492] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:18:13 2021] POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action => generated 32267 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:18:14.787657 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-ca1eaa16-60eb-477f-841d-6bcb62437aca tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action" status: 200 len: 31677 microversion: 2.1 time: 0.172745 Dec 14 03:18:14.788313 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 235/493] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:18:14 2021] POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action => generated 31677 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:18:15.473758 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-ef11f4d4-cc09-40ac-b5ae-cdcae5058bd4 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:15.474475 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-ef11f4d4-cc09-40ac-b5ae-cdcae5058bd4 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: 095d132d-1529-4a41-a033-a8b41a1af328] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:15.484278 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ef11f4d4-cc09-40ac-b5ae-cdcae5058bd4 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:15.484728 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ef11f4d4-cc09-40ac-b5ae-cdcae5058bd4 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:15.485513 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ef11f4d4-cc09-40ac-b5ae-cdcae5058bd4 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:15.485955 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ef11f4d4-cc09-40ac-b5ae-cdcae5058bd4 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:15.613617 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-ef11f4d4-cc09-40ac-b5ae-cdcae5058bd4 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:15.621212 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-ef11f4d4-cc09-40ac-b5ae-cdcae5058bd4 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/095d132d-1529-4a41-a033-a8b41a1af328" status: 200 len: 1318 microversion: 2.1 time: 0.153074 Dec 14 03:18:15.621761 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 259/494] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:18:15 2021] GET /compute/v2.1/servers/095d132d-1529-4a41-a033-a8b41a1af328 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:18:15.630603 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-a3dce9d9-6693-4f1c-9f00-6e2b957cf87a tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:15.631500 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-a3dce9d9-6693-4f1c-9f00-6e2b957cf87a tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: 4687b559-c95a-4b82-a076-a7468c10ebef] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:15.638298 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a3dce9d9-6693-4f1c-9f00-6e2b957cf87a tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:15.638740 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a3dce9d9-6693-4f1c-9f00-6e2b957cf87a tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:15.639549 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a3dce9d9-6693-4f1c-9f00-6e2b957cf87a tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:15.640076 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a3dce9d9-6693-4f1c-9f00-6e2b957cf87a tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:15.680951 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-de7f4e25-3898-4693-83ed-788dc2105021 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:18:15.681961 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-de7f4e25-3898-4693-83ed-788dc2105021 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:15.687858 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-de7f4e25-3898-4693-83ed-788dc2105021 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:15.688311 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-de7f4e25-3898-4693-83ed-788dc2105021 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:15.689086 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-de7f4e25-3898-4693-83ed-788dc2105021 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:15.689521 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-de7f4e25-3898-4693-83ed-788dc2105021 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:15.777228 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-a3dce9d9-6693-4f1c-9f00-6e2b957cf87a tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:15.785027 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-a3dce9d9-6693-4f1c-9f00-6e2b957cf87a tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef" status: 200 len: 1567 microversion: 2.1 time: 0.158991 Dec 14 03:18:15.785585 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 236/495] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:18:15 2021] GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 03:18:15.798758 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-51744725-384a-4e68-b238-4146fd256112 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:18:15.799786 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-51744725-384a-4e68-b238-4146fd256112 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:15.805474 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-51744725-384a-4e68-b238-4146fd256112 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:15.805932 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-51744725-384a-4e68-b238-4146fd256112 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:15.806717 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-51744725-384a-4e68-b238-4146fd256112 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:15.807185 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-51744725-384a-4e68-b238-4146fd256112 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:15.813005 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-de7f4e25-3898-4693-83ed-788dc2105021 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action" status: 200 len: 34315 microversion: 2.20 time: 0.135494 Dec 14 03:18:15.817687 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 260/496] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:18:15 2021] POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action => generated 34315 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 14 03:18:15.918303 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-51744725-384a-4e68-b238-4146fd256112 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action" status: 200 len: 32493 microversion: 2.1 time: 0.122737 Dec 14 03:18:15.918946 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 237/497] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:18:15 2021] POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action => generated 32493 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 14 03:18:16.639567 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-a8070ab6-75eb-4115-a3c0-710510faf9f9 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:16.640230 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-a8070ab6-75eb-4115-a3c0-710510faf9f9 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: 095d132d-1529-4a41-a033-a8b41a1af328] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:16.647443 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a8070ab6-75eb-4115-a3c0-710510faf9f9 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:16.647897 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a8070ab6-75eb-4115-a3c0-710510faf9f9 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:16.648699 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a8070ab6-75eb-4115-a3c0-710510faf9f9 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:16.649139 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a8070ab6-75eb-4115-a3c0-710510faf9f9 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:16.787813 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-a8070ab6-75eb-4115-a3c0-710510faf9f9 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:16.795427 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-a8070ab6-75eb-4115-a3c0-710510faf9f9 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/095d132d-1529-4a41-a033-a8b41a1af328" status: 200 len: 1509 microversion: 2.1 time: 0.159941 Dec 14 03:18:16.795976 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 261/498] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:18:16 2021] GET /compute/v2.1/servers/095d132d-1529-4a41-a033-a8b41a1af328 => generated 1509 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:18:16.801900 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-cbd0b6e7-ece0-430c-ae4d-806e9a16268d tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:16.802695 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-cbd0b6e7-ece0-430c-ae4d-806e9a16268d tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: 4687b559-c95a-4b82-a076-a7468c10ebef] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:16.809781 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-cbd0b6e7-ece0-430c-ae4d-806e9a16268d tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:16.810784 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-cbd0b6e7-ece0-430c-ae4d-806e9a16268d tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:16.811180 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-cbd0b6e7-ece0-430c-ae4d-806e9a16268d tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:16.811622 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-cbd0b6e7-ece0-430c-ae4d-806e9a16268d tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:16.824352 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-4c465e73-f410-4ed9-a6da-691c68cf5183 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:18:16.825262 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-4c465e73-f410-4ed9-a6da-691c68cf5183 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:16.832110 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4c465e73-f410-4ed9-a6da-691c68cf5183 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:16.832557 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4c465e73-f410-4ed9-a6da-691c68cf5183 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:16.833401 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4c465e73-f410-4ed9-a6da-691c68cf5183 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:16.833753 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4c465e73-f410-4ed9-a6da-691c68cf5183 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:16.955839 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-cbd0b6e7-ece0-430c-ae4d-806e9a16268d tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:16.964324 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-cbd0b6e7-ece0-430c-ae4d-806e9a16268d tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef" status: 200 len: 1567 microversion: 2.1 time: 0.166406 Dec 14 03:18:16.964883 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 238/499] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:18:16 2021] GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:18:16.969337 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-91b933a1-b735-4a3f-a89d-c5d54070d41d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:18:16.970450 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-91b933a1-b735-4a3f-a89d-c5d54070d41d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:16.977347 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-91b933a1-b735-4a3f-a89d-c5d54070d41d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:16.977605 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-91b933a1-b735-4a3f-a89d-c5d54070d41d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:16.978626 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-91b933a1-b735-4a3f-a89d-c5d54070d41d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:16.979093 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-91b933a1-b735-4a3f-a89d-c5d54070d41d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:16.980208 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-4c465e73-f410-4ed9-a6da-691c68cf5183 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action" status: 200 len: 34886 microversion: 2.20 time: 0.159252 Dec 14 03:18:16.980895 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 262/500] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:18:16 2021] POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action => generated 34886 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 14 03:18:17.103994 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-91b933a1-b735-4a3f-a89d-c5d54070d41d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action" status: 200 len: 33850 microversion: 2.1 time: 0.137721 Dec 14 03:18:17.104639 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 239/501] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:18:16 2021] POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action => generated 33850 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:18:17.982909 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-3f799dd5-9347-4746-b5e2-7e3daa23b669 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:17.983632 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-3f799dd5-9347-4746-b5e2-7e3daa23b669 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: 4687b559-c95a-4b82-a076-a7468c10ebef] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:17.991021 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3f799dd5-9347-4746-b5e2-7e3daa23b669 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:17.991492 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3f799dd5-9347-4746-b5e2-7e3daa23b669 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:17.992257 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3f799dd5-9347-4746-b5e2-7e3daa23b669 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:17.992684 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3f799dd5-9347-4746-b5e2-7e3daa23b669 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:17.993605 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-5eb15570-bd90-4c49-acd3-89873b4e3c57 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:18:17.994601 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-5eb15570-bd90-4c49-acd3-89873b4e3c57 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:18.001309 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-5eb15570-bd90-4c49-acd3-89873b4e3c57 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:18.001752 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-5eb15570-bd90-4c49-acd3-89873b4e3c57 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:18.002527 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-5eb15570-bd90-4c49-acd3-89873b4e3c57 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:18.003487 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-5eb15570-bd90-4c49-acd3-89873b4e3c57 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:18.125550 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-3f799dd5-9347-4746-b5e2-7e3daa23b669 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:18.134337 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-3f799dd5-9347-4746-b5e2-7e3daa23b669 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef" status: 200 len: 1567 microversion: 2.1 time: 0.155308 Dec 14 03:18:18.134889 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 263/502] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:18:17 2021] GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:18:18.139222 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-35cb1ba3-f9f9-4f3a-8e94-00aaa07327e1 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:18:18.140153 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-35cb1ba3-f9f9-4f3a-8e94-00aaa07327e1 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:18.146560 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-35cb1ba3-f9f9-4f3a-8e94-00aaa07327e1 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:18.147011 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-35cb1ba3-f9f9-4f3a-8e94-00aaa07327e1 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:18.147849 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-35cb1ba3-f9f9-4f3a-8e94-00aaa07327e1 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:18.148286 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-35cb1ba3-f9f9-4f3a-8e94-00aaa07327e1 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:18.157339 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-5eb15570-bd90-4c49-acd3-89873b4e3c57 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action" status: 200 len: 35690 microversion: 2.20 time: 0.167451 Dec 14 03:18:18.157983 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 240/503] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:18:17 2021] POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action => generated 35690 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 14 03:18:18.284281 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-35cb1ba3-f9f9-4f3a-8e94-00aaa07327e1 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action" status: 200 len: 34310 microversion: 2.1 time: 0.148033 Dec 14 03:18:18.285031 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 264/504] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:18:18 2021] POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action => generated 34310 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:18:19.152316 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-8645ff7d-7c7a-4cf7-82a4-8cd46aa18eb5 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:19.153011 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-8645ff7d-7c7a-4cf7-82a4-8cd46aa18eb5 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: 4687b559-c95a-4b82-a076-a7468c10ebef] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:19.160308 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-8645ff7d-7c7a-4cf7-82a4-8cd46aa18eb5 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:19.160756 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-8645ff7d-7c7a-4cf7-82a4-8cd46aa18eb5 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:19.161537 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-8645ff7d-7c7a-4cf7-82a4-8cd46aa18eb5 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:19.162060 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-8645ff7d-7c7a-4cf7-82a4-8cd46aa18eb5 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:19.171714 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-db192acc-5737-40f9-8931-56c5d946200b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:18:19.172712 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-db192acc-5737-40f9-8931-56c5d946200b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:19.181854 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-db192acc-5737-40f9-8931-56c5d946200b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:19.182319 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-db192acc-5737-40f9-8931-56c5d946200b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:19.183144 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-db192acc-5737-40f9-8931-56c5d946200b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:19.183582 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-db192acc-5737-40f9-8931-56c5d946200b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:19.324867 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-db192acc-5737-40f9-8931-56c5d946200b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action" status: 200 len: 36249 microversion: 2.20 time: 0.157687 Dec 14 03:18:19.325510 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 265/505] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:18:19 2021] POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action => generated 36249 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:18:19.330678 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-f50d36f5-ca2a-4320-8160-c219fc37529a tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2449ac23-1fa5-4fec-9226-c00d2785c0c9"}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:18:19.333001 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-f50d36f5-ca2a-4320-8160-c219fc37529a tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: 095d132d-1529-4a41-a033-a8b41a1af328] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:19.338720 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f50d36f5-ca2a-4320-8160-c219fc37529a tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:19.339464 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f50d36f5-ca2a-4320-8160-c219fc37529a tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:19.340241 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f50d36f5-ca2a-4320-8160-c219fc37529a tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:19.340669 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f50d36f5-ca2a-4320-8160-c219fc37529a tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:19.359498 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-8645ff7d-7c7a-4cf7-82a4-8cd46aa18eb5 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:19.367607 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-8645ff7d-7c7a-4cf7-82a4-8cd46aa18eb5 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef" status: 200 len: 1567 microversion: 2.1 time: 0.219175 Dec 14 03:18:19.368161 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 241/506] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:18:19 2021] GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef => generated 1567 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:18:19.372442 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-56724171-c778-4b41-b67e-8b1a1c5adcd9 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:18:19.373353 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-56724171-c778-4b41-b67e-8b1a1c5adcd9 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:19.380501 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-56724171-c778-4b41-b67e-8b1a1c5adcd9 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:19.380989 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-56724171-c778-4b41-b67e-8b1a1c5adcd9 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:19.382177 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-56724171-c778-4b41-b67e-8b1a1c5adcd9 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:19.382603 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-56724171-c778-4b41-b67e-8b1a1c5adcd9 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:19.904499 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-56724171-c778-4b41-b67e-8b1a1c5adcd9 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action" status: 200 len: 35002 microversion: 2.1 time: 0.535016 Dec 14 03:18:19.905107 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 242/507] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:18:19 2021] POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action => generated 35002 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:18:20.098130 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-f50d36f5-ca2a-4320-8160-c219fc37529a tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "POST /compute/v2.1/servers/095d132d-1529-4a41-a033-a8b41a1af328/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.770374 Dec 14 03:18:20.098729 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 266/508] 10.222.0.43 () {60 vars in 1322 bytes} [Tue Dec 14 03:18:19 2021] POST /compute/v2.1/servers/095d132d-1529-4a41-a033-a8b41a1af328/os-volume_attachments => generated 194 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:18:20.337346 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-169fd94e-260b-4b51-8c2b-3ac15613e28f tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:18:20.338343 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-169fd94e-260b-4b51-8c2b-3ac15613e28f tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:20.345084 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-169fd94e-260b-4b51-8c2b-3ac15613e28f tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:20.345535 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-169fd94e-260b-4b51-8c2b-3ac15613e28f tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:20.346311 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-169fd94e-260b-4b51-8c2b-3ac15613e28f tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:20.347318 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-169fd94e-260b-4b51-8c2b-3ac15613e28f tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:20.385318 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-915acfb0-6e6d-4a48-b013-70bbd08a5322 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:20.386378 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-915acfb0-6e6d-4a48-b013-70bbd08a5322 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: 4687b559-c95a-4b82-a076-a7468c10ebef] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:20.392518 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-915acfb0-6e6d-4a48-b013-70bbd08a5322 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:20.392988 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-915acfb0-6e6d-4a48-b013-70bbd08a5322 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:20.393754 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-915acfb0-6e6d-4a48-b013-70bbd08a5322 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:20.394181 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-915acfb0-6e6d-4a48-b013-70bbd08a5322 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:20.523715 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-915acfb0-6e6d-4a48-b013-70bbd08a5322 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:20.531340 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-915acfb0-6e6d-4a48-b013-70bbd08a5322 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef" status: 200 len: 1567 microversion: 2.1 time: 0.150424 Dec 14 03:18:20.531826 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 267/509] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:18:20 2021] GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:18:20.561500 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-169fd94e-260b-4b51-8c2b-3ac15613e28f tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action" status: 200 len: 36860 microversion: 2.20 time: 0.227963 Dec 14 03:18:20.562120 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 243/510] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:18:20 2021] POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action => generated 36860 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:18:20.915304 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-e47f7f5e-7b41-42de-9705-2813a29db45a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:18:20.916276 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-e47f7f5e-7b41-42de-9705-2813a29db45a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:20.922425 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e47f7f5e-7b41-42de-9705-2813a29db45a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:20.922868 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e47f7f5e-7b41-42de-9705-2813a29db45a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:20.923678 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e47f7f5e-7b41-42de-9705-2813a29db45a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:20.924109 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e47f7f5e-7b41-42de-9705-2813a29db45a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:21.085745 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-e47f7f5e-7b41-42de-9705-2813a29db45a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action" status: 200 len: 35875 microversion: 2.1 time: 0.173889 Dec 14 03:18:21.086620 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 268/511] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:18:20 2021] POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action => generated 35875 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:18:21.549184 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-c8ca4f46-0940-406e-995b-ca779e82b4b1 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:21.550759 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-c8ca4f46-0940-406e-995b-ca779e82b4b1 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: 4687b559-c95a-4b82-a076-a7468c10ebef] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:21.557920 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c8ca4f46-0940-406e-995b-ca779e82b4b1 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:21.558398 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c8ca4f46-0940-406e-995b-ca779e82b4b1 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:21.559346 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c8ca4f46-0940-406e-995b-ca779e82b4b1 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:21.559785 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c8ca4f46-0940-406e-995b-ca779e82b4b1 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:21.573325 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-309141dd-3dfc-4395-b917-816f56865f4c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:18:21.574451 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-309141dd-3dfc-4395-b917-816f56865f4c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:21.581380 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-309141dd-3dfc-4395-b917-816f56865f4c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:21.581838 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-309141dd-3dfc-4395-b917-816f56865f4c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:21.582626 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-309141dd-3dfc-4395-b917-816f56865f4c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:21.583094 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-309141dd-3dfc-4395-b917-816f56865f4c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:21.696225 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-c8ca4f46-0940-406e-995b-ca779e82b4b1 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:21.704004 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-c8ca4f46-0940-406e-995b-ca779e82b4b1 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef" status: 200 len: 1547 microversion: 2.1 time: 0.158912 Dec 14 03:18:21.704561 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 244/512] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:18:21 2021] GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef => generated 1547 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:18:21.719555 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-bb0a6ebd-db90-4117-bca7-c5e84ceeb119 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:21.720053 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-bb0a6ebd-db90-4117-bca7-c5e84ceeb119 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: 4687b559-c95a-4b82-a076-a7468c10ebef] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:21.726015 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-bb0a6ebd-db90-4117-bca7-c5e84ceeb119 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:21.726471 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-bb0a6ebd-db90-4117-bca7-c5e84ceeb119 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:21.727289 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-bb0a6ebd-db90-4117-bca7-c5e84ceeb119 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:21.727728 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-bb0a6ebd-db90-4117-bca7-c5e84ceeb119 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:21.748237 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-309141dd-3dfc-4395-b917-816f56865f4c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action" status: 200 len: 37635 microversion: 2.20 time: 0.178805 Dec 14 03:18:21.752577 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 269/513] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:18:21 2021] POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action => generated 37635 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 14 03:18:21.845430 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.wsgi [None req-bb0a6ebd-db90-4117-bca7-c5e84ceeb119 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] HTTP exception thrown: Cannot 'detach_volume' instance 4687b559-c95a-4b82-a076-a7468c10ebef while it is in vm_state rescued Dec 14 03:18:21.846035 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-bb0a6ebd-db90-4117-bca7-c5e84ceeb119 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Returning 409 to user: Cannot 'detach_volume' instance 4687b559-c95a-4b82-a076-a7468c10ebef while it is in vm_state rescued {{(pid=116071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 03:18:21.847439 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-bb0a6ebd-db90-4117-bca7-c5e84ceeb119 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "DELETE /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef/os-volume_attachments/8fc257ab-fecc-4e38-a295-cd87cd187bdc" status: 409 len: 152 microversion: 2.1 time: 0.130773 Dec 14 03:18:21.848184 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 245/514] 10.222.0.43 () {58 vars in 1415 bytes} [Tue Dec 14 03:18:21 2021] DELETE /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef/os-volume_attachments/8fc257ab-fecc-4e38-a295-cd87cd187bdc => generated 152 bytes in 132 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Dec 14 03:18:21.857069 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-b47bedd9-327a-4368-8aab-4282e04c9cf4 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:18:21.858000 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-b47bedd9-327a-4368-8aab-4282e04c9cf4 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: 4687b559-c95a-4b82-a076-a7468c10ebef] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:21.867973 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b47bedd9-327a-4368-8aab-4282e04c9cf4 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:21.868426 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b47bedd9-327a-4368-8aab-4282e04c9cf4 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:21.869212 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b47bedd9-327a-4368-8aab-4282e04c9cf4 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:21.869649 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b47bedd9-327a-4368-8aab-4282e04c9cf4 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:21.933068 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-b47bedd9-327a-4368-8aab-4282e04c9cf4 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "POST /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef/action" status: 202 len: 0 microversion: 2.1 time: 0.079900 Dec 14 03:18:21.933676 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 270/515] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:18:21 2021] POST /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:18:21.941553 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-6ccb12de-200c-4529-9116-7c9fd942491f tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:21.942173 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-6ccb12de-200c-4529-9116-7c9fd942491f tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: 4687b559-c95a-4b82-a076-a7468c10ebef] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:21.949163 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-6ccb12de-200c-4529-9116-7c9fd942491f tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:21.949620 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-6ccb12de-200c-4529-9116-7c9fd942491f tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:21.950442 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-6ccb12de-200c-4529-9116-7c9fd942491f tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:21.950929 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-6ccb12de-200c-4529-9116-7c9fd942491f tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:22.098320 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-b2aafc1b-00a2-4357-beea-c8ad366419c1 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:18:22.099347 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-b2aafc1b-00a2-4357-beea-c8ad366419c1 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:22.105684 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b2aafc1b-00a2-4357-beea-c8ad366419c1 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:22.106185 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b2aafc1b-00a2-4357-beea-c8ad366419c1 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:22.106974 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b2aafc1b-00a2-4357-beea-c8ad366419c1 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:22.107433 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b2aafc1b-00a2-4357-beea-c8ad366419c1 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:22.125483 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-6ccb12de-200c-4529-9116-7c9fd942491f tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:22.135227 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-6ccb12de-200c-4529-9116-7c9fd942491f tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef" status: 200 len: 1555 microversion: 2.1 time: 0.197021 Dec 14 03:18:22.145381 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 246/516] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:18:21 2021] GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef => generated 1555 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:18:22.266846 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-b2aafc1b-00a2-4357-beea-c8ad366419c1 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action" status: 200 len: 36556 microversion: 2.1 time: 0.172963 Dec 14 03:18:22.267525 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 271/517] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:18:22 2021] POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action => generated 36556 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 14 03:18:22.760084 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-91148f7a-bc3e-4afc-9a75-0f83d2780c17 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:18:22.761027 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-91148f7a-bc3e-4afc-9a75-0f83d2780c17 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:22.767262 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-91148f7a-bc3e-4afc-9a75-0f83d2780c17 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:22.767718 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-91148f7a-bc3e-4afc-9a75-0f83d2780c17 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:22.768490 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-91148f7a-bc3e-4afc-9a75-0f83d2780c17 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:22.768928 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-91148f7a-bc3e-4afc-9a75-0f83d2780c17 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:22.882374 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-91148f7a-bc3e-4afc-9a75-0f83d2780c17 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action" status: 200 len: 38143 microversion: 2.20 time: 0.125901 Dec 14 03:18:22.882990 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 247/518] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:18:22 2021] POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action => generated 38143 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 14 03:18:23.153036 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-365caf9a-cd0e-4efd-a7cd-e122f9a734a8 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:23.153729 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-365caf9a-cd0e-4efd-a7cd-e122f9a734a8 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: 4687b559-c95a-4b82-a076-a7468c10ebef] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:23.160991 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-365caf9a-cd0e-4efd-a7cd-e122f9a734a8 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:23.161434 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-365caf9a-cd0e-4efd-a7cd-e122f9a734a8 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:23.162200 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-365caf9a-cd0e-4efd-a7cd-e122f9a734a8 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:23.162630 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-365caf9a-cd0e-4efd-a7cd-e122f9a734a8 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:23.279732 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-2017aa97-67bb-40f2-bf25-c2849e9ce1b3 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:18:23.280853 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-2017aa97-67bb-40f2-bf25-c2849e9ce1b3 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:23.288284 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-2017aa97-67bb-40f2-bf25-c2849e9ce1b3 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:23.288809 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-2017aa97-67bb-40f2-bf25-c2849e9ce1b3 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:23.289666 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-2017aa97-67bb-40f2-bf25-c2849e9ce1b3 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:23.290181 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-2017aa97-67bb-40f2-bf25-c2849e9ce1b3 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:23.297857 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-365caf9a-cd0e-4efd-a7cd-e122f9a734a8 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:23.306126 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-365caf9a-cd0e-4efd-a7cd-e122f9a734a8 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef" status: 200 len: 1555 microversion: 2.1 time: 0.157059 Dec 14 03:18:23.306679 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 272/519] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:18:23 2021] GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef => generated 1555 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:18:23.506438 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-2017aa97-67bb-40f2-bf25-c2849e9ce1b3 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action" status: 200 len: 37514 microversion: 2.1 time: 0.230596 Dec 14 03:18:23.507273 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 248/520] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:18:23 2021] POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action => generated 37514 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:18:23.893642 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-94158b98-0f52-4c22-949a-420b859d7264 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:18:23.894563 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-94158b98-0f52-4c22-949a-420b859d7264 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:23.900790 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-94158b98-0f52-4c22-949a-420b859d7264 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:23.901245 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-94158b98-0f52-4c22-949a-420b859d7264 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:23.902028 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-94158b98-0f52-4c22-949a-420b859d7264 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:23.902467 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-94158b98-0f52-4c22-949a-420b859d7264 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:24.015054 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-94158b98-0f52-4c22-949a-420b859d7264 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action" status: 200 len: 38753 microversion: 2.20 time: 0.124899 Dec 14 03:18:24.015700 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 273/521] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:18:23 2021] POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action => generated 38753 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:18:24.323630 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-27e13556-e6b5-4e61-b3c9-66918269c567 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:24.324412 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-27e13556-e6b5-4e61-b3c9-66918269c567 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: 4687b559-c95a-4b82-a076-a7468c10ebef] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:24.331838 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-27e13556-e6b5-4e61-b3c9-66918269c567 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:24.332296 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-27e13556-e6b5-4e61-b3c9-66918269c567 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:24.333095 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-27e13556-e6b5-4e61-b3c9-66918269c567 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:24.333535 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-27e13556-e6b5-4e61-b3c9-66918269c567 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:24.460874 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-27e13556-e6b5-4e61-b3c9-66918269c567 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:24.469037 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-27e13556-e6b5-4e61-b3c9-66918269c567 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef" status: 200 len: 1555 microversion: 2.1 time: 0.149343 Dec 14 03:18:24.469599 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 249/522] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:18:24 2021] GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef => generated 1555 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:18:24.518269 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-ba4576cb-4a70-4a0b-ac4d-f46305df2623 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:18:24.519282 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-ba4576cb-4a70-4a0b-ac4d-f46305df2623 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:24.525891 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ba4576cb-4a70-4a0b-ac4d-f46305df2623 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:24.526330 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ba4576cb-4a70-4a0b-ac4d-f46305df2623 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:24.527111 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ba4576cb-4a70-4a0b-ac4d-f46305df2623 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:24.527540 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ba4576cb-4a70-4a0b-ac4d-f46305df2623 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:24.635986 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-ba4576cb-4a70-4a0b-ac4d-f46305df2623 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action" status: 200 len: 38098 microversion: 2.1 time: 0.121446 Dec 14 03:18:24.636980 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 274/523] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:18:24 2021] POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action => generated 38098 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:18:25.027147 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-b3d4016f-e8f2-452a-8d32-38bb3674abdb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:18:25.028064 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-b3d4016f-e8f2-452a-8d32-38bb3674abdb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:25.034556 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b3d4016f-e8f2-452a-8d32-38bb3674abdb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:25.035034 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b3d4016f-e8f2-452a-8d32-38bb3674abdb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:25.035845 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b3d4016f-e8f2-452a-8d32-38bb3674abdb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:25.036288 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b3d4016f-e8f2-452a-8d32-38bb3674abdb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:25.178829 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-b3d4016f-e8f2-452a-8d32-38bb3674abdb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action" status: 200 len: 38753 microversion: 2.20 time: 0.155470 Dec 14 03:18:25.179733 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 250/524] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:18:25 2021] POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action => generated 38753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 14 03:18:25.486698 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-11175509-4bd8-454b-ada0-d052bb7a62d4 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:25.487413 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-11175509-4bd8-454b-ada0-d052bb7a62d4 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: 4687b559-c95a-4b82-a076-a7468c10ebef] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:25.494361 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-11175509-4bd8-454b-ada0-d052bb7a62d4 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:25.494807 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-11175509-4bd8-454b-ada0-d052bb7a62d4 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:25.495593 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-11175509-4bd8-454b-ada0-d052bb7a62d4 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:25.496041 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-11175509-4bd8-454b-ada0-d052bb7a62d4 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:25.626119 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-11175509-4bd8-454b-ada0-d052bb7a62d4 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:25.634667 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-11175509-4bd8-454b-ada0-d052bb7a62d4 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef" status: 200 len: 1555 microversion: 2.1 time: 0.151889 Dec 14 03:18:25.635245 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 275/525] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:18:25 2021] GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef => generated 1555 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:18:25.649016 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-1b07813c-df3c-4221-b7b8-937a5a27e56a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:18:25.650081 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-1b07813c-df3c-4221-b7b8-937a5a27e56a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:25.656947 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-1b07813c-df3c-4221-b7b8-937a5a27e56a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:25.657398 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-1b07813c-df3c-4221-b7b8-937a5a27e56a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:25.658194 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-1b07813c-df3c-4221-b7b8-937a5a27e56a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:25.658635 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-1b07813c-df3c-4221-b7b8-937a5a27e56a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:25.769517 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-1b07813c-df3c-4221-b7b8-937a5a27e56a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action" status: 200 len: 38098 microversion: 2.1 time: 0.124345 Dec 14 03:18:25.771084 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 251/526] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:18:25 2021] POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action => generated 38098 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:18:26.190075 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-6682ef1c-b4d4-41ee-8f92-fbaf6322445a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:18:26.190989 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-6682ef1c-b4d4-41ee-8f92-fbaf6322445a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:26.197248 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6682ef1c-b4d4-41ee-8f92-fbaf6322445a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:26.197698 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6682ef1c-b4d4-41ee-8f92-fbaf6322445a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:26.198471 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6682ef1c-b4d4-41ee-8f92-fbaf6322445a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:26.198934 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6682ef1c-b4d4-41ee-8f92-fbaf6322445a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:26.319097 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-6682ef1c-b4d4-41ee-8f92-fbaf6322445a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action" status: 200 len: 38753 microversion: 2.20 time: 0.132524 Dec 14 03:18:26.320397 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 276/527] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:18:26 2021] POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action => generated 38753 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:18:26.652501 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-6d76b69c-1ee5-4d43-966d-54c98e1818c3 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:26.653202 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-6d76b69c-1ee5-4d43-966d-54c98e1818c3 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: 4687b559-c95a-4b82-a076-a7468c10ebef] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:26.660224 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-6d76b69c-1ee5-4d43-966d-54c98e1818c3 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:26.660896 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-6d76b69c-1ee5-4d43-966d-54c98e1818c3 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:26.661463 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-6d76b69c-1ee5-4d43-966d-54c98e1818c3 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:26.661909 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-6d76b69c-1ee5-4d43-966d-54c98e1818c3 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:26.781565 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-2ff39ea1-c470-44df-9852-f43644ec9cb0 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:18:26.782549 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-2ff39ea1-c470-44df-9852-f43644ec9cb0 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:26.789585 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2ff39ea1-c470-44df-9852-f43644ec9cb0 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:26.790034 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2ff39ea1-c470-44df-9852-f43644ec9cb0 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:26.790809 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2ff39ea1-c470-44df-9852-f43644ec9cb0 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:26.791270 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2ff39ea1-c470-44df-9852-f43644ec9cb0 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:26.791399 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-6d76b69c-1ee5-4d43-966d-54c98e1818c3 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:26.800075 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-6d76b69c-1ee5-4d43-966d-54c98e1818c3 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef" status: 200 len: 1555 microversion: 2.1 time: 0.151090 Dec 14 03:18:26.800655 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 252/528] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:18:26 2021] GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef => generated 1555 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:18:27.047154 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-2ff39ea1-c470-44df-9852-f43644ec9cb0 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action" status: 200 len: 38098 microversion: 2.1 time: 0.269228 Dec 14 03:18:27.047788 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 277/529] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:18:26 2021] POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action => generated 38098 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 14 03:18:27.331303 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-c36f349b-84ed-4698-9920-d0baf5c58ee6 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:18:27.332238 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-c36f349b-84ed-4698-9920-d0baf5c58ee6 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:27.338456 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c36f349b-84ed-4698-9920-d0baf5c58ee6 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:27.338924 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c36f349b-84ed-4698-9920-d0baf5c58ee6 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:27.339719 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c36f349b-84ed-4698-9920-d0baf5c58ee6 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:27.340159 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c36f349b-84ed-4698-9920-d0baf5c58ee6 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:27.498946 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-c36f349b-84ed-4698-9920-d0baf5c58ee6 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action" status: 200 len: 38753 microversion: 2.20 time: 0.171624 Dec 14 03:18:27.499815 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 253/530] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:18:27 2021] POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action => generated 38753 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 14 03:18:27.817325 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-a692324a-16a2-4f8b-8236-908be547baf3 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:27.818016 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-a692324a-16a2-4f8b-8236-908be547baf3 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: 4687b559-c95a-4b82-a076-a7468c10ebef] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:27.825003 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a692324a-16a2-4f8b-8236-908be547baf3 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:27.825659 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a692324a-16a2-4f8b-8236-908be547baf3 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:27.826773 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a692324a-16a2-4f8b-8236-908be547baf3 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:27.827150 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a692324a-16a2-4f8b-8236-908be547baf3 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:27.960990 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-a692324a-16a2-4f8b-8236-908be547baf3 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:27.969313 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-a692324a-16a2-4f8b-8236-908be547baf3 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef" status: 200 len: 1561 microversion: 2.1 time: 0.156030 Dec 14 03:18:27.969877 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 278/531] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:18:27 2021] GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef => generated 1561 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:18:28.034178 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-9f513906-9647-4e11-a233-bfbdaef951c7 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:28.035317 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-9f513906-9647-4e11-a233-bfbdaef951c7 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: 4687b559-c95a-4b82-a076-a7468c10ebef] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:28.042073 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-9f513906-9647-4e11-a233-bfbdaef951c7 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:28.042527 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-9f513906-9647-4e11-a233-bfbdaef951c7 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:28.043334 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-9f513906-9647-4e11-a233-bfbdaef951c7 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:28.043804 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-9f513906-9647-4e11-a233-bfbdaef951c7 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:28.058381 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-0ff58614-5006-49bf-b6bc-023c32e242c4 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:18:28.059410 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-0ff58614-5006-49bf-b6bc-023c32e242c4 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:28.065172 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0ff58614-5006-49bf-b6bc-023c32e242c4 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:28.065625 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0ff58614-5006-49bf-b6bc-023c32e242c4 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:28.066408 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0ff58614-5006-49bf-b6bc-023c32e242c4 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:28.066847 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0ff58614-5006-49bf-b6bc-023c32e242c4 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:28.122705 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.objects.instance [None req-9f513906-9647-4e11-a233-bfbdaef951c7 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lazy-loading 'services' on Instance uuid 4687b559-c95a-4b82-a076-a7468c10ebef {{(pid=116071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 14 03:18:28.168158 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-0ff58614-5006-49bf-b6bc-023c32e242c4 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action" status: 200 len: 38098 microversion: 2.1 time: 0.113074 Dec 14 03:18:28.169543 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 279/532] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:18:28 2021] POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action => generated 38098 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 14 03:18:28.228114 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-9f513906-9647-4e11-a233-bfbdaef951c7 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "DELETE /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef/os-volume_attachments/8fc257ab-fecc-4e38-a295-cd87cd187bdc" status: 202 len: 0 microversion: 2.1 time: 0.197876 Dec 14 03:18:28.228683 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 254/533] 10.222.0.43 () {58 vars in 1415 bytes} [Tue Dec 14 03:18:28 2021] DELETE /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef/os-volume_attachments/8fc257ab-fecc-4e38-a295-cd87cd187bdc => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:18:28.237595 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-c786bc8c-f22d-4e99-ab06-bdd6b051f9a9 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:28.238894 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-c786bc8c-f22d-4e99-ab06-bdd6b051f9a9 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: 4687b559-c95a-4b82-a076-a7468c10ebef] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:28.245752 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c786bc8c-f22d-4e99-ab06-bdd6b051f9a9 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:28.246208 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c786bc8c-f22d-4e99-ab06-bdd6b051f9a9 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:28.246999 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c786bc8c-f22d-4e99-ab06-bdd6b051f9a9 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:28.247464 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c786bc8c-f22d-4e99-ab06-bdd6b051f9a9 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:28.277400 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-c786bc8c-f22d-4e99-ab06-bdd6b051f9a9 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043849 Dec 14 03:18:28.277965 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 280/534] 10.222.0.43 () {58 vars in 1301 bytes} [Tue Dec 14 03:18:28 2021] GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:18:28.512332 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-3bf9f742-0e07-446d-9182-36dca76415c7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:18:28.513335 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-3bf9f742-0e07-446d-9182-36dca76415c7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:28.519972 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-3bf9f742-0e07-446d-9182-36dca76415c7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:28.520433 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-3bf9f742-0e07-446d-9182-36dca76415c7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:28.521224 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-3bf9f742-0e07-446d-9182-36dca76415c7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:28.521667 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-3bf9f742-0e07-446d-9182-36dca76415c7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:28.606700 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-ac428cdb-ccff-41e3-a7f7-92e77c563b63 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2449ac23-1fa5-4fec-9226-c00d2785c0c9"}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:18:28.607788 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-ac428cdb-ccff-41e3-a7f7-92e77c563b63 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: 095d132d-1529-4a41-a033-a8b41a1af328] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:28.614194 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ac428cdb-ccff-41e3-a7f7-92e77c563b63 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:28.614635 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ac428cdb-ccff-41e3-a7f7-92e77c563b63 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:28.615432 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ac428cdb-ccff-41e3-a7f7-92e77c563b63 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:28.615868 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ac428cdb-ccff-41e3-a7f7-92e77c563b63 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:28.655487 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-3bf9f742-0e07-446d-9182-36dca76415c7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action" status: 200 len: 38753 microversion: 2.20 time: 0.147328 Dec 14 03:18:28.656134 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 255/535] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:18:28 2021] POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action => generated 38753 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:18:28.692858 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.wsgi [None req-ac428cdb-ccff-41e3-a7f7-92e77c563b63 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] HTTP exception thrown: Invalid volume: volume 2449ac23-1fa5-4fec-9226-c00d2785c0c9 is already attached to instances: 095d132d-1529-4a41-a033-a8b41a1af328 Dec 14 03:18:28.693863 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-ac428cdb-ccff-41e3-a7f7-92e77c563b63 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Returning 400 to user: Invalid volume: volume 2449ac23-1fa5-4fec-9226-c00d2785c0c9 is already attached to instances: 095d132d-1529-4a41-a033-a8b41a1af328 {{(pid=116072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 03:18:28.695197 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-ac428cdb-ccff-41e3-a7f7-92e77c563b63 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "POST /compute/v2.1/servers/095d132d-1529-4a41-a033-a8b41a1af328/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.091994 Dec 14 03:18:28.696011 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 281/536] 10.222.0.43 () {60 vars in 1322 bytes} [Tue Dec 14 03:18:28 2021] POST /compute/v2.1/servers/095d132d-1529-4a41-a033-a8b41a1af328/os-volume_attachments => generated 174 bytes in 94 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Dec 14 03:18:28.753787 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-18d94d7a-7c3d-4eb9-91ab-3e8d13cbc2b8 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:28.754381 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-18d94d7a-7c3d-4eb9-91ab-3e8d13cbc2b8 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: 095d132d-1529-4a41-a033-a8b41a1af328] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:28.761175 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-18d94d7a-7c3d-4eb9-91ab-3e8d13cbc2b8 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:28.761630 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-18d94d7a-7c3d-4eb9-91ab-3e8d13cbc2b8 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:28.762414 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-18d94d7a-7c3d-4eb9-91ab-3e8d13cbc2b8 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:28.762857 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-18d94d7a-7c3d-4eb9-91ab-3e8d13cbc2b8 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:28.838094 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.objects.instance [None req-18d94d7a-7c3d-4eb9-91ab-3e8d13cbc2b8 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lazy-loading 'services' on Instance uuid 095d132d-1529-4a41-a033-a8b41a1af328 {{(pid=116071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 14 03:18:28.905189 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-18d94d7a-7c3d-4eb9-91ab-3e8d13cbc2b8 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "DELETE /compute/v2.1/servers/095d132d-1529-4a41-a033-a8b41a1af328/os-volume_attachments/2449ac23-1fa5-4fec-9226-c00d2785c0c9" status: 202 len: 0 microversion: 2.1 time: 0.155857 Dec 14 03:18:28.905795 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 256/537] 10.222.0.43 () {58 vars in 1415 bytes} [Tue Dec 14 03:18:28 2021] DELETE /compute/v2.1/servers/095d132d-1529-4a41-a033-a8b41a1af328/os-volume_attachments/2449ac23-1fa5-4fec-9226-c00d2785c0c9 => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:18:28.913913 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-9c5b61a7-65b8-488b-bb42-0075e85fc97a tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:28.914841 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-9c5b61a7-65b8-488b-bb42-0075e85fc97a tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: 095d132d-1529-4a41-a033-a8b41a1af328] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:28.921932 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9c5b61a7-65b8-488b-bb42-0075e85fc97a tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:28.922450 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9c5b61a7-65b8-488b-bb42-0075e85fc97a tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:28.923243 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9c5b61a7-65b8-488b-bb42-0075e85fc97a tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:28.923677 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9c5b61a7-65b8-488b-bb42-0075e85fc97a tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:28.954600 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-9c5b61a7-65b8-488b-bb42-0075e85fc97a tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/095d132d-1529-4a41-a033-a8b41a1af328/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044194 Dec 14 03:18:28.955101 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 282/538] 10.222.0.43 () {58 vars in 1301 bytes} [Tue Dec 14 03:18:28 2021] GET /compute/v2.1/servers/095d132d-1529-4a41-a033-a8b41a1af328/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:18:29.180221 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-6dc99067-91f4-4a02-be29-2cf132c7ea4b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:18:29.181519 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-6dc99067-91f4-4a02-be29-2cf132c7ea4b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:29.188254 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-6dc99067-91f4-4a02-be29-2cf132c7ea4b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:29.188730 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-6dc99067-91f4-4a02-be29-2cf132c7ea4b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:29.189533 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-6dc99067-91f4-4a02-be29-2cf132c7ea4b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:29.189973 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-6dc99067-91f4-4a02-be29-2cf132c7ea4b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:29.289348 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-56f80d4a-f349-4b79-86a2-e63a168b2d11 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:29.290363 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-56f80d4a-f349-4b79-86a2-e63a168b2d11 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: 4687b559-c95a-4b82-a076-a7468c10ebef] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:29.296619 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-56f80d4a-f349-4b79-86a2-e63a168b2d11 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:29.297080 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-56f80d4a-f349-4b79-86a2-e63a168b2d11 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:29.297827 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-56f80d4a-f349-4b79-86a2-e63a168b2d11 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:29.298335 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-56f80d4a-f349-4b79-86a2-e63a168b2d11 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:29.314913 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-6dc99067-91f4-4a02-be29-2cf132c7ea4b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action" status: 200 len: 38229 microversion: 2.1 time: 0.138478 Dec 14 03:18:29.316549 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 257/539] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:18:29 2021] POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action => generated 38229 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:18:29.325593 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-8f299d78-fa3e-4bcd-bc26-7a9dbd463ecb tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:29.326173 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-8f299d78-fa3e-4bcd-bc26-7a9dbd463ecb tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:29.327509 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-56f80d4a-f349-4b79-86a2-e63a168b2d11 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041826 Dec 14 03:18:29.328047 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 283/540] 10.222.0.43 () {58 vars in 1301 bytes} [Tue Dec 14 03:18:29 2021] GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 14 03:18:29.332295 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-8f299d78-fa3e-4bcd-bc26-7a9dbd463ecb tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:29.332745 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-8f299d78-fa3e-4bcd-bc26-7a9dbd463ecb tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:29.333514 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-8f299d78-fa3e-4bcd-bc26-7a9dbd463ecb tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:29.333947 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-8f299d78-fa3e-4bcd-bc26-7a9dbd463ecb tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:29.359887 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-8f299d78-fa3e-4bcd-bc26-7a9dbd463ecb tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/ips" status: 200 len: 145 microversion: 2.1 time: 0.038015 Dec 14 03:18:29.360424 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 258/541] 10.222.0.43 () {58 vars in 1247 bytes} [Tue Dec 14 03:18:29 2021] GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/ips => generated 145 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 14 03:18:29.666688 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-0220ecad-d16a-4816-9c41-5ddeb938c09d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:18:29.667643 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-0220ecad-d16a-4816-9c41-5ddeb938c09d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:29.674228 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0220ecad-d16a-4816-9c41-5ddeb938c09d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:29.675377 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0220ecad-d16a-4816-9c41-5ddeb938c09d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:29.676157 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0220ecad-d16a-4816-9c41-5ddeb938c09d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:29.676586 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0220ecad-d16a-4816-9c41-5ddeb938c09d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:29.849147 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-0220ecad-d16a-4816-9c41-5ddeb938c09d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action" status: 200 len: 38894 microversion: 2.20 time: 0.186119 Dec 14 03:18:29.849805 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 284/542] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:18:29 2021] POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action => generated 38894 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 14 03:18:29.859858 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-350334cd-4750-4b0f-896c-8af4da44cf59 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:29.860352 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-350334cd-4750-4b0f-896c-8af4da44cf59 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:29.867513 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-350334cd-4750-4b0f-896c-8af4da44cf59 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:29.867960 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-350334cd-4750-4b0f-896c-8af4da44cf59 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:29.868735 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-350334cd-4750-4b0f-896c-8af4da44cf59 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:29.869170 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-350334cd-4750-4b0f-896c-8af4da44cf59 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:29.891074 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-350334cd-4750-4b0f-896c-8af4da44cf59 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/ips" status: 200 len: 151 microversion: 2.20 time: 0.034907 Dec 14 03:18:29.891617 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 259/543] 10.222.0.43 () {60 vars in 1288 bytes} [Tue Dec 14 03:18:29 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/ips => generated 151 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:18:29.966084 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-c7a8a73d-a995-497c-8eef-285b166fcadf tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:29.967164 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-c7a8a73d-a995-497c-8eef-285b166fcadf tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: 095d132d-1529-4a41-a033-a8b41a1af328] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:29.974390 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c7a8a73d-a995-497c-8eef-285b166fcadf tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:29.974878 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c7a8a73d-a995-497c-8eef-285b166fcadf tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:29.975679 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c7a8a73d-a995-497c-8eef-285b166fcadf tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:29.976120 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c7a8a73d-a995-497c-8eef-285b166fcadf tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:30.005455 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-c7a8a73d-a995-497c-8eef-285b166fcadf tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/095d132d-1529-4a41-a033-a8b41a1af328/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043370 Dec 14 03:18:30.005963 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 285/544] 10.222.0.43 () {58 vars in 1301 bytes} [Tue Dec 14 03:18:29 2021] GET /compute/v2.1/servers/095d132d-1529-4a41-a033-a8b41a1af328/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:18:30.338958 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-e5b557af-08c0-4d25-9fa0-05af29f03527 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:30.339967 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-e5b557af-08c0-4d25-9fa0-05af29f03527 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: 4687b559-c95a-4b82-a076-a7468c10ebef] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:30.346149 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-e5b557af-08c0-4d25-9fa0-05af29f03527 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:30.347301 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-e5b557af-08c0-4d25-9fa0-05af29f03527 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:30.348085 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-e5b557af-08c0-4d25-9fa0-05af29f03527 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:30.348523 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-e5b557af-08c0-4d25-9fa0-05af29f03527 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:30.375965 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-e5b557af-08c0-4d25-9fa0-05af29f03527 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040648 Dec 14 03:18:30.376429 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 260/545] 10.222.0.43 () {58 vars in 1301 bytes} [Tue Dec 14 03:18:30 2021] GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 14 03:18:31.016761 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-8e747db0-c248-4f1c-8af1-a133bbd240f9 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:31.017606 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-8e747db0-c248-4f1c-8af1-a133bbd240f9 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: 095d132d-1529-4a41-a033-a8b41a1af328] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:31.023898 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8e747db0-c248-4f1c-8af1-a133bbd240f9 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:31.024349 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8e747db0-c248-4f1c-8af1-a133bbd240f9 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:31.025123 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8e747db0-c248-4f1c-8af1-a133bbd240f9 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:31.025557 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8e747db0-c248-4f1c-8af1-a133bbd240f9 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:31.055688 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-8e747db0-c248-4f1c-8af1-a133bbd240f9 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/095d132d-1529-4a41-a033-a8b41a1af328/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042636 Dec 14 03:18:31.056244 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 286/546] 10.222.0.43 () {58 vars in 1301 bytes} [Tue Dec 14 03:18:31 2021] GET /compute/v2.1/servers/095d132d-1529-4a41-a033-a8b41a1af328/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:18:32.066075 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-b8399a58-b579-41b9-b2c0-85a5f0c4d1ae tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:32.066988 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-b8399a58-b579-41b9-b2c0-85a5f0c4d1ae tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: 095d132d-1529-4a41-a033-a8b41a1af328] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:32.073257 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b8399a58-b579-41b9-b2c0-85a5f0c4d1ae tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:32.073720 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b8399a58-b579-41b9-b2c0-85a5f0c4d1ae tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:32.074495 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b8399a58-b579-41b9-b2c0-85a5f0c4d1ae tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:32.074932 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b8399a58-b579-41b9-b2c0-85a5f0c4d1ae tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:32.106125 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-b8399a58-b579-41b9-b2c0-85a5f0c4d1ae tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/095d132d-1529-4a41-a033-a8b41a1af328/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043757 Dec 14 03:18:32.107589 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 261/547] 10.222.0.43 () {58 vars in 1301 bytes} [Tue Dec 14 03:18:32 2021] GET /compute/v2.1/servers/095d132d-1529-4a41-a033-a8b41a1af328/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 14 03:18:32.202937 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-5fd579fa-bfde-437d-8767-017652a43d87 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-973116024", "imageRef": "4fff76a9-6620-4bda-b1ec-2cd3719c946a", "flavorRef": "452", "networks": [{"uuid": "69a3889e-636a-4983-9398-edafd7db5301"}]}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:18:32.254176 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.network.neutron [None req-5fd579fa-bfde-437d-8767-017652a43d87 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] validate_networks() for [('69a3889e-636a-4983-9398-edafd7db5301', None, None, None, None, None)] {{(pid=116072) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 14 03:18:32.628761 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-5fd579fa-bfde-437d-8767-017652a43d87 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Flavor limits 0:0:0 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 14 03:18:32.629480 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-5fd579fa-bfde-437d-8767-017652a43d87 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Image limits 0:0:0 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 14 03:18:32.630356 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-5fd579fa-bfde-437d-8767-017652a43d87 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Flavor pref 0:0:0 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 14 03:18:32.630861 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-5fd579fa-bfde-437d-8767-017652a43d87 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Image pref 0:0:0 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 14 03:18:32.631584 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-5fd579fa-bfde-437d-8767-017652a43d87 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 14 03:18:32.641549 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5fd579fa-bfde-437d-8767-017652a43d87 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:32.642522 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5fd579fa-bfde-437d-8767-017652a43d87 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:32.643684 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5fd579fa-bfde-437d-8767-017652a43d87 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:32.644252 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5fd579fa-bfde-437d-8767-017652a43d87 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:32.662207 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.quota [None req-5fd579fa-bfde-437d-8767-017652a43d87 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Getting quotas for project 7ecea5c13a624ab8a3a445d3ede5fd77. Resources: {'cores', 'instances', 'ram'} {{(pid=116072) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 03:18:32.666243 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.quota [None req-5fd579fa-bfde-437d-8767-017652a43d87 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Getting quotas for user 0a133cb1175e4130902bbcdeaedd74f9 and project 7ecea5c13a624ab8a3a445d3ede5fd77. Resources: {'cores', 'instances', 'ram'} {{(pid=116072) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 03:18:32.677500 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-5fd579fa-bfde-437d-8767-017652a43d87 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Going to run 1 instances... {{(pid=116072) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 14 03:18:32.680142 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-5fd579fa-bfde-437d-8767-017652a43d87 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: 10269bb5-0ad1-46fb-b4a2-62e573eb2dcd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4fff76a9-6620-4bda-b1ec-2cd3719c946a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 14 03:18:32.733925 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-5fd579fa-bfde-437d-8767-017652a43d87 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.534482 Dec 14 03:18:32.734818 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 287/548] 10.222.0.43 () {60 vars in 1146 bytes} [Tue Dec 14 03:18:32 2021] POST /compute/v2.1/servers => generated 380 bytes in 536 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 14 03:18:32.745554 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-ac05b59a-fe8c-4990-9068-371fa48455d8 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:32.745989 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-ac05b59a-fe8c-4990-9068-371fa48455d8 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: 10269bb5-0ad1-46fb-b4a2-62e573eb2dcd] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:32.800633 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-ac05b59a-fe8c-4990-9068-371fa48455d8 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:32.808295 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-ac05b59a-fe8c-4990-9068-371fa48455d8 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/10269bb5-0ad1-46fb-b4a2-62e573eb2dcd" status: 200 len: 1217 microversion: 2.1 time: 0.066837 Dec 14 03:18:32.808855 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 262/549] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:18:32 2021] GET /compute/v2.1/servers/10269bb5-0ad1-46fb-b4a2-62e573eb2dcd => generated 1217 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:18:33.301720 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-8594db4c-4dd7-457b-a634-c539bfd07f98 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:18:33.302338 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-8594db4c-4dd7-457b-a634-c539bfd07f98 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:33.309719 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8594db4c-4dd7-457b-a634-c539bfd07f98 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:33.310177 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8594db4c-4dd7-457b-a634-c539bfd07f98 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:33.310966 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8594db4c-4dd7-457b-a634-c539bfd07f98 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:33.311425 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8594db4c-4dd7-457b-a634-c539bfd07f98 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:33.334202 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.objects.instance [None req-8594db4c-4dd7-457b-a634-c539bfd07f98 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lazy-loading 'flavor' on Instance uuid 86395107-d320-45d8-83de-f1848858be10 {{(pid=116072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 14 03:18:33.461318 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-834c8c2b-b65d-489c-9e3e-2f89d58f7923 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1a480dac-a351-4833-98cd-285d4f080698"}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:18:33.462527 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-834c8c2b-b65d-489c-9e3e-2f89d58f7923 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:33.469575 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-834c8c2b-b65d-489c-9e3e-2f89d58f7923 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:33.470027 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-834c8c2b-b65d-489c-9e3e-2f89d58f7923 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:33.470838 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-834c8c2b-b65d-489c-9e3e-2f89d58f7923 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:33.471302 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-834c8c2b-b65d-489c-9e3e-2f89d58f7923 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:33.628322 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-8594db4c-4dd7-457b-a634-c539bfd07f98 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action" status: 202 len: 0 microversion: 2.20 time: 0.330135 Dec 14 03:18:33.629563 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 288/550] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:18:33 2021] POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 14 03:18:33.638931 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-603a1203-4e0b-4875-85e5-dbfb8243856e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:33.640256 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-603a1203-4e0b-4875-85e5-dbfb8243856e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:33.651832 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-603a1203-4e0b-4875-85e5-dbfb8243856e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:33.654164 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-603a1203-4e0b-4875-85e5-dbfb8243856e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:33.655005 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-603a1203-4e0b-4875-85e5-dbfb8243856e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:33.655509 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-603a1203-4e0b-4875-85e5-dbfb8243856e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:33.755020 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-834c8c2b-b65d-489c-9e3e-2f89d58f7923 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.296772 Dec 14 03:18:33.761867 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 263/551] 10.222.0.43 () {60 vars in 1322 bytes} [Tue Dec 14 03:18:33 2021] POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/os-volume_attachments => generated 194 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 14 03:18:33.807835 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-603a1203-4e0b-4875-85e5-dbfb8243856e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:33.820891 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-603a1203-4e0b-4875-85e5-dbfb8243856e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:33.822678 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-603a1203-4e0b-4875-85e5-dbfb8243856e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:33.824062 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-603a1203-4e0b-4875-85e5-dbfb8243856e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1723 microversion: 2.20 time: 0.190274 Dec 14 03:18:33.824609 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 289/552] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:18:33 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1723 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 14 03:18:33.827490 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-58e90c45-85be-41c9-8f04-6301b74a0178 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:33.828456 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-58e90c45-85be-41c9-8f04-6301b74a0178 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: 10269bb5-0ad1-46fb-b4a2-62e573eb2dcd] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:33.835288 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-58e90c45-85be-41c9-8f04-6301b74a0178 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:33.835801 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-58e90c45-85be-41c9-8f04-6301b74a0178 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:33.836599 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-58e90c45-85be-41c9-8f04-6301b74a0178 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:33.837028 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-58e90c45-85be-41c9-8f04-6301b74a0178 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:33.897305 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-58e90c45-85be-41c9-8f04-6301b74a0178 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:33.904667 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-58e90c45-85be-41c9-8f04-6301b74a0178 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/10269bb5-0ad1-46fb-b4a2-62e573eb2dcd" status: 200 len: 1269 microversion: 2.1 time: 0.081492 Dec 14 03:18:33.905222 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 264/553] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:18:33 2021] GET /compute/v2.1/servers/10269bb5-0ad1-46fb-b4a2-62e573eb2dcd => generated 1269 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:18:34.807118 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-ecd7344c-b29b-47fd-a4c9-1060fb1587da tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:34.807735 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-ecd7344c-b29b-47fd-a4c9-1060fb1587da tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: c6283570-4ee2-47bc-b58a-fbfe57acbcde] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:34.814076 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ecd7344c-b29b-47fd-a4c9-1060fb1587da tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:34.814879 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ecd7344c-b29b-47fd-a4c9-1060fb1587da tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:34.815979 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ecd7344c-b29b-47fd-a4c9-1060fb1587da tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:34.817191 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ecd7344c-b29b-47fd-a4c9-1060fb1587da tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:34.844831 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-677c6209-fb0f-48b3-915f-95e79dc2eabb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:34.845452 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-677c6209-fb0f-48b3-915f-95e79dc2eabb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:34.852362 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-ecd7344c-b29b-47fd-a4c9-1060fb1587da tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: c6283570-4ee2-47bc-b58a-fbfe57acbcde] Going to try to terminate instance {{(pid=116072) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 14 03:18:34.861531 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-677c6209-fb0f-48b3-915f-95e79dc2eabb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:34.862047 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-677c6209-fb0f-48b3-915f-95e79dc2eabb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:34.865482 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-677c6209-fb0f-48b3-915f-95e79dc2eabb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:34.865963 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-677c6209-fb0f-48b3-915f-95e79dc2eabb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:34.964073 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-ecd7344c-b29b-47fd-a4c9-1060fb1587da tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "DELETE /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde" status: 204 len: 0 microversion: 2.1 time: 0.160805 Dec 14 03:18:34.965334 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 290/554] 10.222.0.43 () {58 vars in 1238 bytes} [Tue Dec 14 03:18:34 2021] DELETE /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 14 03:18:34.974346 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-758d9ec8-a7ae-40f9-b536-45bbab61199b tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:34.975808 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-758d9ec8-a7ae-40f9-b536-45bbab61199b tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: 10269bb5-0ad1-46fb-b4a2-62e573eb2dcd] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:34.983760 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-758d9ec8-a7ae-40f9-b536-45bbab61199b tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:34.984216 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-758d9ec8-a7ae-40f9-b536-45bbab61199b tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:34.985037 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-758d9ec8-a7ae-40f9-b536-45bbab61199b tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:34.985679 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-758d9ec8-a7ae-40f9-b536-45bbab61199b tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:35.224449 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-677c6209-fb0f-48b3-915f-95e79dc2eabb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:35.237389 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-677c6209-fb0f-48b3-915f-95e79dc2eabb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:35.239804 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-677c6209-fb0f-48b3-915f-95e79dc2eabb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:35.240971 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-677c6209-fb0f-48b3-915f-95e79dc2eabb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1723 microversion: 2.20 time: 0.401401 Dec 14 03:18:35.241527 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 265/555] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:18:34 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1723 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:18:35.256635 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-fde90889-4b04-4e5f-b6b1-ab86e314ea49 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:35.257243 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-fde90889-4b04-4e5f-b6b1-ab86e314ea49 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: c6283570-4ee2-47bc-b58a-fbfe57acbcde] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:35.262967 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-fde90889-4b04-4e5f-b6b1-ab86e314ea49 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:35.263477 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-fde90889-4b04-4e5f-b6b1-ab86e314ea49 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:35.264265 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-fde90889-4b04-4e5f-b6b1-ab86e314ea49 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:35.264702 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-fde90889-4b04-4e5f-b6b1-ab86e314ea49 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:35.279436 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-758d9ec8-a7ae-40f9-b536-45bbab61199b tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:35.287468 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-758d9ec8-a7ae-40f9-b536-45bbab61199b tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/10269bb5-0ad1-46fb-b4a2-62e573eb2dcd" status: 200 len: 1317 microversion: 2.1 time: 0.320702 Dec 14 03:18:35.288039 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 291/556] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:18:34 2021] GET /compute/v2.1/servers/10269bb5-0ad1-46fb-b4a2-62e573eb2dcd => generated 1317 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:18:35.477749 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-fde90889-4b04-4e5f-b6b1-ab86e314ea49 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:35.485227 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-fde90889-4b04-4e5f-b6b1-ab86e314ea49 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde" status: 200 len: 1508 microversion: 2.1 time: 0.231953 Dec 14 03:18:35.485797 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 266/557] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:18:35 2021] GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde => generated 1508 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:18:35.597239 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [req-711aa1b3-e22a-497e-8393-619e5dc30944 req-262c573d-eea8-48c7-9cbe-ac8b4c67d92a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10269bb5-0ad1-46fb-b4a2-62e573eb2dcd", "tag": "2ee7b357-17c9-4ac1-be00-9130e426631c"}]} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:18:35.599413 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:18:35.599413 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: warnings.warn(msg) Dec 14 03:18:35.606553 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-711aa1b3-e22a-497e-8393-619e5dc30944 req-262c573d-eea8-48c7-9cbe-ac8b4c67d92a service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:35.607158 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-711aa1b3-e22a-497e-8393-619e5dc30944 req-262c573d-eea8-48c7-9cbe-ac8b4c67d92a service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:35.620463 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.compute.server_external_events [req-711aa1b3-e22a-497e-8393-619e5dc30944 req-262c573d-eea8-48c7-9cbe-ac8b4c67d92a service nova] Creating event network-changed:2ee7b357-17c9-4ac1-be00-9130e426631c for instance 10269bb5-0ad1-46fb-b4a2-62e573eb2dcd on hv-cinder-81803 Dec 14 03:18:35.624891 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [req-711aa1b3-e22a-497e-8393-619e5dc30944 req-262c573d-eea8-48c7-9cbe-ac8b4c67d92a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031214 Dec 14 03:18:35.625475 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 292/558] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Dec 14 03:18:35 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:18:36.260542 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-a217f345-7a11-403a-866a-ecbd17ed91d5 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:36.261271 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-a217f345-7a11-403a-866a-ecbd17ed91d5 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:36.267565 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a217f345-7a11-403a-866a-ecbd17ed91d5 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:36.268015 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a217f345-7a11-403a-866a-ecbd17ed91d5 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:36.268815 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a217f345-7a11-403a-866a-ecbd17ed91d5 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:36.269252 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a217f345-7a11-403a-866a-ecbd17ed91d5 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:36.305908 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-402ebc0a-2043-4344-af51-01d18ddeae57 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:36.306782 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-402ebc0a-2043-4344-af51-01d18ddeae57 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: 10269bb5-0ad1-46fb-b4a2-62e573eb2dcd] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:36.312859 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-402ebc0a-2043-4344-af51-01d18ddeae57 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:36.313250 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-402ebc0a-2043-4344-af51-01d18ddeae57 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:36.314031 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-402ebc0a-2043-4344-af51-01d18ddeae57 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:36.314468 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-402ebc0a-2043-4344-af51-01d18ddeae57 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:36.792280 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-a217f345-7a11-403a-866a-ecbd17ed91d5 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:36.800114 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-a217f345-7a11-403a-866a-ecbd17ed91d5 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:36.801894 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-a217f345-7a11-403a-866a-ecbd17ed91d5 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:36.803480 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-a217f345-7a11-403a-866a-ecbd17ed91d5 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1723 microversion: 2.20 time: 0.546823 Dec 14 03:18:36.804045 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 267/559] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:18:36 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1723 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:18:36.808266 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-4956b7cc-c6e7-4821-81f6-dcbfd4dde4ef tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:36.808902 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-4956b7cc-c6e7-4821-81f6-dcbfd4dde4ef tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: c6283570-4ee2-47bc-b58a-fbfe57acbcde] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:36.812961 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-402ebc0a-2043-4344-af51-01d18ddeae57 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:36.816133 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-4956b7cc-c6e7-4821-81f6-dcbfd4dde4ef tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:36.817102 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-4956b7cc-c6e7-4821-81f6-dcbfd4dde4ef tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:36.817898 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-4956b7cc-c6e7-4821-81f6-dcbfd4dde4ef tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:36.818339 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-4956b7cc-c6e7-4821-81f6-dcbfd4dde4ef tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:36.821537 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-402ebc0a-2043-4344-af51-01d18ddeae57 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/10269bb5-0ad1-46fb-b4a2-62e573eb2dcd" status: 200 len: 1317 microversion: 2.1 time: 0.520245 Dec 14 03:18:36.822044 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 293/560] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:18:36 2021] GET /compute/v2.1/servers/10269bb5-0ad1-46fb-b4a2-62e573eb2dcd => generated 1317 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 03:18:37.065652 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-4956b7cc-c6e7-4821-81f6-dcbfd4dde4ef tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:37.073870 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-4956b7cc-c6e7-4821-81f6-dcbfd4dde4ef tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde" status: 200 len: 1508 microversion: 2.1 time: 0.268779 Dec 14 03:18:37.074654 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 268/561] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:18:36 2021] GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde => generated 1508 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:18:37.821852 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-9882342c-5b01-4973-8f73-2b0f0b60c40f tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:37.822459 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-9882342c-5b01-4973-8f73-2b0f0b60c40f tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:37.828606 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9882342c-5b01-4973-8f73-2b0f0b60c40f tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:37.829047 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9882342c-5b01-4973-8f73-2b0f0b60c40f tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:37.829810 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9882342c-5b01-4973-8f73-2b0f0b60c40f tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:37.830245 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9882342c-5b01-4973-8f73-2b0f0b60c40f tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:37.837449 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-c8f0a464-6b56-4dcf-bd5a-9c03e3522a10 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:37.838055 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-c8f0a464-6b56-4dcf-bd5a-9c03e3522a10 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: 10269bb5-0ad1-46fb-b4a2-62e573eb2dcd] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:37.844802 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c8f0a464-6b56-4dcf-bd5a-9c03e3522a10 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:37.845255 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c8f0a464-6b56-4dcf-bd5a-9c03e3522a10 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:37.846106 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c8f0a464-6b56-4dcf-bd5a-9c03e3522a10 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:37.846491 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c8f0a464-6b56-4dcf-bd5a-9c03e3522a10 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:38.036554 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-9882342c-5b01-4973-8f73-2b0f0b60c40f tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:38.042192 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-c8f0a464-6b56-4dcf-bd5a-9c03e3522a10 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:38.045680 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-9882342c-5b01-4973-8f73-2b0f0b60c40f tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:38.047472 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-9882342c-5b01-4973-8f73-2b0f0b60c40f tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:38.048809 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-9882342c-5b01-4973-8f73-2b0f0b60c40f tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1723 microversion: 2.20 time: 0.230564 Dec 14 03:18:38.050320 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-c8f0a464-6b56-4dcf-bd5a-9c03e3522a10 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/10269bb5-0ad1-46fb-b4a2-62e573eb2dcd" status: 200 len: 1317 microversion: 2.1 time: 0.216259 Dec 14 03:18:38.050459 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 294/562] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:18:37 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1723 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:18:38.051302 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 269/563] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:18:37 2021] GET /compute/v2.1/servers/10269bb5-0ad1-46fb-b4a2-62e573eb2dcd => generated 1317 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:18:38.090789 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-a0dc362a-17c9-435f-a26e-efca37c2ab95 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:38.092386 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-a0dc362a-17c9-435f-a26e-efca37c2ab95 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: c6283570-4ee2-47bc-b58a-fbfe57acbcde] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:38.098083 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a0dc362a-17c9-435f-a26e-efca37c2ab95 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:38.098548 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a0dc362a-17c9-435f-a26e-efca37c2ab95 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:38.099459 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a0dc362a-17c9-435f-a26e-efca37c2ab95 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:38.099926 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a0dc362a-17c9-435f-a26e-efca37c2ab95 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:38.274687 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-a0dc362a-17c9-435f-a26e-efca37c2ab95 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:38.282059 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-a0dc362a-17c9-435f-a26e-efca37c2ab95 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde" status: 200 len: 1508 microversion: 2.1 time: 0.195202 Dec 14 03:18:38.282619 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 295/564] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:18:38 2021] GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde => generated 1508 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:18:39.067296 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-35cc3105-b658-4ba1-afa0-5cd809c822cc tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:39.067906 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-35cc3105-b658-4ba1-afa0-5cd809c822cc tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: 10269bb5-0ad1-46fb-b4a2-62e573eb2dcd] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:39.068054 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-9808fc38-840c-46b0-a81f-64997ebc2b1d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:39.068667 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-9808fc38-840c-46b0-a81f-64997ebc2b1d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:39.074167 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-35cc3105-b658-4ba1-afa0-5cd809c822cc tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:39.074611 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-35cc3105-b658-4ba1-afa0-5cd809c822cc tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:39.074874 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9808fc38-840c-46b0-a81f-64997ebc2b1d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:39.075428 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9808fc38-840c-46b0-a81f-64997ebc2b1d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:39.075545 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-35cc3105-b658-4ba1-afa0-5cd809c822cc tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:39.075904 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-35cc3105-b658-4ba1-afa0-5cd809c822cc tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:39.076234 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9808fc38-840c-46b0-a81f-64997ebc2b1d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:39.076668 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9808fc38-840c-46b0-a81f-64997ebc2b1d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:39.289502 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-35cc3105-b658-4ba1-afa0-5cd809c822cc tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:39.293003 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-9808fc38-840c-46b0-a81f-64997ebc2b1d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:39.297356 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-35cc3105-b658-4ba1-afa0-5cd809c822cc tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/10269bb5-0ad1-46fb-b4a2-62e573eb2dcd" status: 200 len: 1317 microversion: 2.1 time: 0.233623 Dec 14 03:18:39.297940 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 270/565] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:18:39 2021] GET /compute/v2.1/servers/10269bb5-0ad1-46fb-b4a2-62e573eb2dcd => generated 1317 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:18:39.302317 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-9808fc38-840c-46b0-a81f-64997ebc2b1d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:39.303071 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-d2ff9b24-b3b0-44e0-967c-5e1df5892dab tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:39.303822 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-d2ff9b24-b3b0-44e0-967c-5e1df5892dab tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: c6283570-4ee2-47bc-b58a-fbfe57acbcde] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:39.304072 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-9808fc38-840c-46b0-a81f-64997ebc2b1d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:39.305298 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-9808fc38-840c-46b0-a81f-64997ebc2b1d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1723 microversion: 2.20 time: 0.240848 Dec 14 03:18:39.306035 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 296/566] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:18:39 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1723 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 14 03:18:39.309662 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-d2ff9b24-b3b0-44e0-967c-5e1df5892dab tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:39.310320 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-d2ff9b24-b3b0-44e0-967c-5e1df5892dab tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:39.311412 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-d2ff9b24-b3b0-44e0-967c-5e1df5892dab tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:39.311855 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-d2ff9b24-b3b0-44e0-967c-5e1df5892dab tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:39.544983 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-d2ff9b24-b3b0-44e0-967c-5e1df5892dab tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:39.552769 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-d2ff9b24-b3b0-44e0-967c-5e1df5892dab tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde" status: 200 len: 1508 microversion: 2.1 time: 0.253669 Dec 14 03:18:39.553640 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 271/567] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:18:39 2021] GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde => generated 1508 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:18:39.861827 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [req-54e8a079-d3e2-48d3-9ef3-cd8624560245 req-ec4047e1-0948-4145-8a83-be44e13707db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6283570-4ee2-47bc-b58a-fbfe57acbcde", "name": "network-vif-deleted", "tag": "4b8834a4-3f18-49ea-b3a2-4053d903f624"}]} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:18:39.865243 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:18:39.865243 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: warnings.warn(msg) Dec 14 03:18:39.873177 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-54e8a079-d3e2-48d3-9ef3-cd8624560245 req-ec4047e1-0948-4145-8a83-be44e13707db service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:39.873621 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-54e8a079-d3e2-48d3-9ef3-cd8624560245 req-ec4047e1-0948-4145-8a83-be44e13707db service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:39.885460 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.compute.server_external_events [req-54e8a079-d3e2-48d3-9ef3-cd8624560245 req-ec4047e1-0948-4145-8a83-be44e13707db service nova] Creating event network-vif-deleted:4b8834a4-3f18-49ea-b3a2-4053d903f624 for instance c6283570-4ee2-47bc-b58a-fbfe57acbcde on hv-cinder-81803 Dec 14 03:18:39.890716 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [req-54e8a079-d3e2-48d3-9ef3-cd8624560245 req-ec4047e1-0948-4145-8a83-be44e13707db service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033001 Dec 14 03:18:39.891406 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 297/568] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Dec 14 03:18:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:18:40.314566 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-1a5dfaf0-0b22-443d-b856-d640a833b68e tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:40.315224 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-1a5dfaf0-0b22-443d-b856-d640a833b68e tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: 10269bb5-0ad1-46fb-b4a2-62e573eb2dcd] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:40.322102 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-1a5dfaf0-0b22-443d-b856-d640a833b68e tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:40.322557 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-1a5dfaf0-0b22-443d-b856-d640a833b68e tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:40.323373 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-1a5dfaf0-0b22-443d-b856-d640a833b68e tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:40.323817 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-1a5dfaf0-0b22-443d-b856-d640a833b68e tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:40.323942 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-6cea4d51-c9d9-42e8-bb45-9fb001fbf243 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:40.324629 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-6cea4d51-c9d9-42e8-bb45-9fb001fbf243 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:40.331088 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6cea4d51-c9d9-42e8-bb45-9fb001fbf243 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:40.331535 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6cea4d51-c9d9-42e8-bb45-9fb001fbf243 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:40.333001 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6cea4d51-c9d9-42e8-bb45-9fb001fbf243 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:40.333430 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6cea4d51-c9d9-42e8-bb45-9fb001fbf243 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:40.524055 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-6cea4d51-c9d9-42e8-bb45-9fb001fbf243 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:40.528399 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-1a5dfaf0-0b22-443d-b856-d640a833b68e tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:40.531989 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-6cea4d51-c9d9-42e8-bb45-9fb001fbf243 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:40.533496 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-6cea4d51-c9d9-42e8-bb45-9fb001fbf243 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:40.534851 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-6cea4d51-c9d9-42e8-bb45-9fb001fbf243 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1723 microversion: 2.20 time: 0.214831 Dec 14 03:18:40.535440 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 298/569] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:18:40 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1723 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 14 03:18:40.535676 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-1a5dfaf0-0b22-443d-b856-d640a833b68e tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/10269bb5-0ad1-46fb-b4a2-62e573eb2dcd" status: 200 len: 1317 microversion: 2.1 time: 0.224771 Dec 14 03:18:40.536235 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 272/570] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:18:40 2021] GET /compute/v2.1/servers/10269bb5-0ad1-46fb-b4a2-62e573eb2dcd => generated 1317 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:18:40.570148 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-f046e0af-57fd-4f30-b529-153558a1c5cd tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:40.570768 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-f046e0af-57fd-4f30-b529-153558a1c5cd tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: c6283570-4ee2-47bc-b58a-fbfe57acbcde] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:40.577492 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f046e0af-57fd-4f30-b529-153558a1c5cd tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:40.577953 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f046e0af-57fd-4f30-b529-153558a1c5cd tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:40.578901 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f046e0af-57fd-4f30-b529-153558a1c5cd tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:40.579436 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f046e0af-57fd-4f30-b529-153558a1c5cd tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:40.610367 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f046e0af-57fd-4f30-b529-153558a1c5cd tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:40.610816 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f046e0af-57fd-4f30-b529-153558a1c5cd tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:40.611289 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.objects.instance [None req-f046e0af-57fd-4f30-b529-153558a1c5cd tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lazy-loading 'fault' on Instance uuid c6283570-4ee2-47bc-b58a-fbfe57acbcde {{(pid=116072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 14 03:18:40.653906 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-f046e0af-57fd-4f30-b529-153558a1c5cd tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:40.670905 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-f046e0af-57fd-4f30-b529-153558a1c5cd tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde" status: 200 len: 1312 microversion: 2.1 time: 0.105095 Dec 14 03:18:40.671623 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 299/571] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:18:40 2021] GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde => generated 1312 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:18:41.552048 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-a9d33a09-bbef-4c5c-af88-0129fc905596 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:41.552574 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-662d97f2-8c1f-4e84-89d0-c6a72891c332 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:41.552927 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-a9d33a09-bbef-4c5c-af88-0129fc905596 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:41.553018 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-662d97f2-8c1f-4e84-89d0-c6a72891c332 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: 10269bb5-0ad1-46fb-b4a2-62e573eb2dcd] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:41.558632 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-662d97f2-8c1f-4e84-89d0-c6a72891c332 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:41.559112 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-662d97f2-8c1f-4e84-89d0-c6a72891c332 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:41.559532 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a9d33a09-bbef-4c5c-af88-0129fc905596 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:41.559901 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-662d97f2-8c1f-4e84-89d0-c6a72891c332 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:41.560044 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a9d33a09-bbef-4c5c-af88-0129fc905596 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:41.560524 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-662d97f2-8c1f-4e84-89d0-c6a72891c332 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:41.561633 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a9d33a09-bbef-4c5c-af88-0129fc905596 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:41.562983 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a9d33a09-bbef-4c5c-af88-0129fc905596 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:41.761168 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-662d97f2-8c1f-4e84-89d0-c6a72891c332 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:41.763622 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-a9d33a09-bbef-4c5c-af88-0129fc905596 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:41.769161 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-662d97f2-8c1f-4e84-89d0-c6a72891c332 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/10269bb5-0ad1-46fb-b4a2-62e573eb2dcd" status: 200 len: 1317 microversion: 2.1 time: 0.220596 Dec 14 03:18:41.770071 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 273/572] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:18:41 2021] GET /compute/v2.1/servers/10269bb5-0ad1-46fb-b4a2-62e573eb2dcd => generated 1317 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:18:41.771857 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-a9d33a09-bbef-4c5c-af88-0129fc905596 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:41.773571 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-a9d33a09-bbef-4c5c-af88-0129fc905596 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:41.775166 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-a9d33a09-bbef-4c5c-af88-0129fc905596 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1723 microversion: 2.20 time: 0.226638 Dec 14 03:18:41.775861 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 300/573] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:18:41 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1723 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 14 03:18:41.777438 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-d9133d8e-6ee6-49f8-80e3-fa006cd9c08c tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:41.778076 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-d9133d8e-6ee6-49f8-80e3-fa006cd9c08c tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: c6283570-4ee2-47bc-b58a-fbfe57acbcde] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:41.784891 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-d9133d8e-6ee6-49f8-80e3-fa006cd9c08c tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:41.786433 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-d9133d8e-6ee6-49f8-80e3-fa006cd9c08c tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:41.789025 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-d9133d8e-6ee6-49f8-80e3-fa006cd9c08c tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:41.789478 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-d9133d8e-6ee6-49f8-80e3-fa006cd9c08c tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:41.805174 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.wsgi [None req-d9133d8e-6ee6-49f8-80e3-fa006cd9c08c tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] HTTP exception thrown: Instance c6283570-4ee2-47bc-b58a-fbfe57acbcde could not be found. Dec 14 03:18:41.805783 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-d9133d8e-6ee6-49f8-80e3-fa006cd9c08c tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Returning 404 to user: Instance c6283570-4ee2-47bc-b58a-fbfe57acbcde could not be found. {{(pid=116071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 03:18:41.806612 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-d9133d8e-6ee6-49f8-80e3-fa006cd9c08c tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde" status: 404 len: 111 microversion: 2.1 time: 0.035174 Dec 14 03:18:41.807189 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 274/574] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:18:41 2021] GET /compute/v2.1/servers/c6283570-4ee2-47bc-b58a-fbfe57acbcde => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 14 03:18:41.814870 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-38f3f031-f45a-4a92-bc1c-f7c5958365a8 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:41.815806 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-38f3f031-f45a-4a92-bc1c-f7c5958365a8 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: 4687b559-c95a-4b82-a076-a7468c10ebef] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:41.821332 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-38f3f031-f45a-4a92-bc1c-f7c5958365a8 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:41.821777 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-38f3f031-f45a-4a92-bc1c-f7c5958365a8 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:41.822549 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-38f3f031-f45a-4a92-bc1c-f7c5958365a8 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:41.823010 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-38f3f031-f45a-4a92-bc1c-f7c5958365a8 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:41.848102 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-38f3f031-f45a-4a92-bc1c-f7c5958365a8 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: 4687b559-c95a-4b82-a076-a7468c10ebef] Going to try to terminate instance {{(pid=116072) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 14 03:18:41.920833 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-38f3f031-f45a-4a92-bc1c-f7c5958365a8 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "DELETE /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef" status: 204 len: 0 microversion: 2.1 time: 0.109229 Dec 14 03:18:41.921415 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 301/575] 10.222.0.43 () {58 vars in 1238 bytes} [Tue Dec 14 03:18:41 2021] DELETE /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 14 03:18:41.929607 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-6ccdae3f-11b6-4a88-acf8-d4586bf48b06 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:41.930214 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-6ccdae3f-11b6-4a88-acf8-d4586bf48b06 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: 4687b559-c95a-4b82-a076-a7468c10ebef] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:41.936059 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-6ccdae3f-11b6-4a88-acf8-d4586bf48b06 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:41.936779 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-6ccdae3f-11b6-4a88-acf8-d4586bf48b06 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:41.937530 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-6ccdae3f-11b6-4a88-acf8-d4586bf48b06 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:41.937966 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-6ccdae3f-11b6-4a88-acf8-d4586bf48b06 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:42.068745 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-6ccdae3f-11b6-4a88-acf8-d4586bf48b06 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:42.076003 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-6ccdae3f-11b6-4a88-acf8-d4586bf48b06 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef" status: 200 len: 1521 microversion: 2.1 time: 0.150548 Dec 14 03:18:42.076561 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 275/576] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:18:41 2021] GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:18:42.356307 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-2e45506e-229a-4536-a3e2-d3ba3e2a12d3 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:18:42.362018 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2e45506e-229a-4536-a3e2-d3ba3e2a12d3 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:42.362475 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2e45506e-229a-4536-a3e2-d3ba3e2a12d3 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:42.422106 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-2e45506e-229a-4536-a3e2-d3ba3e2a12d3 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Going to try to stop instance {{(pid=116072) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Dec 14 03:18:42.463585 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-2e45506e-229a-4536-a3e2-d3ba3e2a12d3 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action" status: 202 len: 0 microversion: 2.1 time: 0.111011 Dec 14 03:18:42.464233 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 302/577] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:18:42 2021] POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:18:42.471939 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-293ac7ba-be85-4e75-b253-29e68a539cf4 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:42.472591 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-293ac7ba-be85-4e75-b253-29e68a539cf4 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:42.478400 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-293ac7ba-be85-4e75-b253-29e68a539cf4 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:42.478874 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-293ac7ba-be85-4e75-b253-29e68a539cf4 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:42.479695 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-293ac7ba-be85-4e75-b253-29e68a539cf4 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:42.480142 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-293ac7ba-be85-4e75-b253-29e68a539cf4 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:42.606386 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-293ac7ba-be85-4e75-b253-29e68a539cf4 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107444106cda461dab7c403665d92613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:42.614921 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-293ac7ba-be85-4e75-b253-29e68a539cf4 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364" status: 200 len: 1722 microversion: 2.1 time: 0.146596 Dec 14 03:18:42.615502 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 276/578] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:18:42 2021] GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364 => generated 1722 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:18:42.786819 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-2617c9a5-e4ae-44bf-b242-94a51c6db003 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:42.787619 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-2617c9a5-e4ae-44bf-b242-94a51c6db003 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: 10269bb5-0ad1-46fb-b4a2-62e573eb2dcd] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:42.793509 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-b5a692af-35d6-4da0-a70d-9f6184b0f6ad tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:42.794224 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2617c9a5-e4ae-44bf-b242-94a51c6db003 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:42.794397 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-b5a692af-35d6-4da0-a70d-9f6184b0f6ad tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:42.794668 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2617c9a5-e4ae-44bf-b242-94a51c6db003 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:42.795461 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2617c9a5-e4ae-44bf-b242-94a51c6db003 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:42.795889 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2617c9a5-e4ae-44bf-b242-94a51c6db003 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:42.799934 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b5a692af-35d6-4da0-a70d-9f6184b0f6ad tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:42.800384 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b5a692af-35d6-4da0-a70d-9f6184b0f6ad tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:42.801795 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b5a692af-35d6-4da0-a70d-9f6184b0f6ad tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:42.802227 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b5a692af-35d6-4da0-a70d-9f6184b0f6ad tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:42.984790 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-2617c9a5-e4ae-44bf-b242-94a51c6db003 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:42.992008 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-b5a692af-35d6-4da0-a70d-9f6184b0f6ad tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:42.992344 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-2617c9a5-e4ae-44bf-b242-94a51c6db003 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/10269bb5-0ad1-46fb-b4a2-62e573eb2dcd" status: 200 len: 1317 microversion: 2.1 time: 0.209993 Dec 14 03:18:42.992902 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 303/579] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:18:42 2021] GET /compute/v2.1/servers/10269bb5-0ad1-46fb-b4a2-62e573eb2dcd => generated 1317 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:18:43.000120 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-b5a692af-35d6-4da0-a70d-9f6184b0f6ad tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:43.001705 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-b5a692af-35d6-4da0-a70d-9f6184b0f6ad tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:43.002862 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-b5a692af-35d6-4da0-a70d-9f6184b0f6ad tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1723 microversion: 2.20 time: 0.212994 Dec 14 03:18:43.003439 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 277/580] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:18:42 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1723 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 14 03:18:43.092527 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-930d4082-9d94-49d4-bdc4-343fff605b10 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:43.093138 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-930d4082-9d94-49d4-bdc4-343fff605b10 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: 4687b559-c95a-4b82-a076-a7468c10ebef] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:43.099618 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-930d4082-9d94-49d4-bdc4-343fff605b10 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:43.100054 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-930d4082-9d94-49d4-bdc4-343fff605b10 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:43.100866 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-930d4082-9d94-49d4-bdc4-343fff605b10 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:43.101306 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-930d4082-9d94-49d4-bdc4-343fff605b10 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:43.228188 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-930d4082-9d94-49d4-bdc4-343fff605b10 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:43.235278 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-930d4082-9d94-49d4-bdc4-343fff605b10 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef" status: 200 len: 1521 microversion: 2.1 time: 0.146272 Dec 14 03:18:43.235837 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 304/581] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:18:43 2021] GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:18:43.632487 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-6c10c504-2d13-4a48-982a-69f94b111c71 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:43.633113 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-6c10c504-2d13-4a48-982a-69f94b111c71 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:43.639400 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-6c10c504-2d13-4a48-982a-69f94b111c71 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:43.639856 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-6c10c504-2d13-4a48-982a-69f94b111c71 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:43.640637 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-6c10c504-2d13-4a48-982a-69f94b111c71 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:43.641075 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-6c10c504-2d13-4a48-982a-69f94b111c71 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:43.849680 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-6c10c504-2d13-4a48-982a-69f94b111c71 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107444106cda461dab7c403665d92613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:43.857376 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-6c10c504-2d13-4a48-982a-69f94b111c71 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364" status: 200 len: 1722 microversion: 2.1 time: 0.229069 Dec 14 03:18:43.857930 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 278/582] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:18:43 2021] GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364 => generated 1722 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:18:44.009438 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-1686df0c-2d24-47d0-b029-788483a97bef tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:44.010041 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-1686df0c-2d24-47d0-b029-788483a97bef tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: 10269bb5-0ad1-46fb-b4a2-62e573eb2dcd] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:44.016540 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1686df0c-2d24-47d0-b029-788483a97bef tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:44.016992 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1686df0c-2d24-47d0-b029-788483a97bef tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:44.017775 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1686df0c-2d24-47d0-b029-788483a97bef tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:44.018397 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1686df0c-2d24-47d0-b029-788483a97bef tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:44.021323 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-7c20faf3-797d-47d2-889f-97953ab5b866 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:44.022176 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-7c20faf3-797d-47d2-889f-97953ab5b866 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:44.028605 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-7c20faf3-797d-47d2-889f-97953ab5b866 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:44.029195 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-7c20faf3-797d-47d2-889f-97953ab5b866 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:44.030080 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-7c20faf3-797d-47d2-889f-97953ab5b866 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:44.030612 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-7c20faf3-797d-47d2-889f-97953ab5b866 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:44.242913 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-1686df0c-2d24-47d0-b029-788483a97bef tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:44.251461 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-1686df0c-2d24-47d0-b029-788483a97bef tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/10269bb5-0ad1-46fb-b4a2-62e573eb2dcd" status: 200 len: 1317 microversion: 2.1 time: 0.245548 Dec 14 03:18:44.252125 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 305/583] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:18:44 2021] GET /compute/v2.1/servers/10269bb5-0ad1-46fb-b4a2-62e573eb2dcd => generated 1317 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:18:44.256405 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-992edb7e-7f13-46c1-be03-e1edc3f18a6b tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:44.257018 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-992edb7e-7f13-46c1-be03-e1edc3f18a6b tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: 4687b559-c95a-4b82-a076-a7468c10ebef] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:44.257437 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-7c20faf3-797d-47d2-889f-97953ab5b866 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:44.262716 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-992edb7e-7f13-46c1-be03-e1edc3f18a6b tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:44.263204 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-992edb7e-7f13-46c1-be03-e1edc3f18a6b tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:44.263989 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-992edb7e-7f13-46c1-be03-e1edc3f18a6b tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:44.264428 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-992edb7e-7f13-46c1-be03-e1edc3f18a6b tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:44.265703 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-7c20faf3-797d-47d2-889f-97953ab5b866 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:44.267458 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-7c20faf3-797d-47d2-889f-97953ab5b866 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:44.268862 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-7c20faf3-797d-47d2-889f-97953ab5b866 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1723 microversion: 2.20 time: 0.251530 Dec 14 03:18:44.269487 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 279/584] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:18:44 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1723 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:18:44.391926 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-992edb7e-7f13-46c1-be03-e1edc3f18a6b tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:44.400270 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-992edb7e-7f13-46c1-be03-e1edc3f18a6b tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef" status: 200 len: 1521 microversion: 2.1 time: 0.147052 Dec 14 03:18:44.401767 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 306/585] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:18:44 2021] GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:18:44.875093 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-139c55cd-266d-4c33-a48a-c8c485687ac9 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:44.875699 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-139c55cd-266d-4c33-a48a-c8c485687ac9 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:44.882420 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-139c55cd-266d-4c33-a48a-c8c485687ac9 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:44.882868 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-139c55cd-266d-4c33-a48a-c8c485687ac9 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:44.883667 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-139c55cd-266d-4c33-a48a-c8c485687ac9 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:44.884104 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-139c55cd-266d-4c33-a48a-c8c485687ac9 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:45.012035 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-139c55cd-266d-4c33-a48a-c8c485687ac9 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107444106cda461dab7c403665d92613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:45.020178 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-139c55cd-266d-4c33-a48a-c8c485687ac9 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364" status: 200 len: 1722 microversion: 2.1 time: 0.148052 Dec 14 03:18:45.020771 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 280/586] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:18:44 2021] GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364 => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:18:45.268426 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-fce6dfd3-6660-4ced-9ea9-ca9fa9676f6c tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:45.268963 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-fce6dfd3-6660-4ced-9ea9-ca9fa9676f6c tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: 10269bb5-0ad1-46fb-b4a2-62e573eb2dcd] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:45.275344 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-fce6dfd3-6660-4ced-9ea9-ca9fa9676f6c tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:45.275799 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-fce6dfd3-6660-4ced-9ea9-ca9fa9676f6c tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:45.276575 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-fce6dfd3-6660-4ced-9ea9-ca9fa9676f6c tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:45.277012 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-fce6dfd3-6660-4ced-9ea9-ca9fa9676f6c tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:45.286443 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-d834619a-02eb-42e7-a1b5-bd84ea94460d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:45.287112 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-d834619a-02eb-42e7-a1b5-bd84ea94460d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:45.292851 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-d834619a-02eb-42e7-a1b5-bd84ea94460d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:45.293303 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-d834619a-02eb-42e7-a1b5-bd84ea94460d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:45.294086 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-d834619a-02eb-42e7-a1b5-bd84ea94460d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:45.294529 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-d834619a-02eb-42e7-a1b5-bd84ea94460d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:45.463279 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-fce6dfd3-6660-4ced-9ea9-ca9fa9676f6c tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:45.470467 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-fce6dfd3-6660-4ced-9ea9-ca9fa9676f6c tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/10269bb5-0ad1-46fb-b4a2-62e573eb2dcd" status: 200 len: 1317 microversion: 2.1 time: 0.205751 Dec 14 03:18:45.480122 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 307/587] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:18:45 2021] GET /compute/v2.1/servers/10269bb5-0ad1-46fb-b4a2-62e573eb2dcd => generated 1317 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 03:18:45.480414 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-d834619a-02eb-42e7-a1b5-bd84ea94460d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:45.480533 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-b9c6e5b9-2156-45ee-9e8f-2c382d6ee999 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:45.480533 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-b9c6e5b9-2156-45ee-9e8f-2c382d6ee999 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: 4687b559-c95a-4b82-a076-a7468c10ebef] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:45.481483 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b9c6e5b9-2156-45ee-9e8f-2c382d6ee999 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:45.481945 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b9c6e5b9-2156-45ee-9e8f-2c382d6ee999 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:45.482836 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-d834619a-02eb-42e7-a1b5-bd84ea94460d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:45.482968 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b9c6e5b9-2156-45ee-9e8f-2c382d6ee999 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:45.483453 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b9c6e5b9-2156-45ee-9e8f-2c382d6ee999 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:45.484589 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-d834619a-02eb-42e7-a1b5-bd84ea94460d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:45.485759 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-d834619a-02eb-42e7-a1b5-bd84ea94460d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1723 microversion: 2.20 time: 0.202960 Dec 14 03:18:45.486459 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 281/588] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:18:45 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1723 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 14 03:18:45.527032 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [req-310796dd-a6fd-4932-84a0-f9a00dc926ad req-8a94a1ad-876e-49a9-8a19-7ea70d03a28a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10269bb5-0ad1-46fb-b4a2-62e573eb2dcd", "name": "network-vif-plugged", "status": "completed", "tag": "2ee7b357-17c9-4ac1-be00-9130e426631c"}]} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:18:45.529394 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:18:45.529394 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: warnings.warn(msg) Dec 14 03:18:45.537790 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [req-310796dd-a6fd-4932-84a0-f9a00dc926ad req-8a94a1ad-876e-49a9-8a19-7ea70d03a28a service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:45.538268 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [req-310796dd-a6fd-4932-84a0-f9a00dc926ad req-8a94a1ad-876e-49a9-8a19-7ea70d03a28a service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:45.549506 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.compute.server_external_events [req-310796dd-a6fd-4932-84a0-f9a00dc926ad req-8a94a1ad-876e-49a9-8a19-7ea70d03a28a service nova] Creating event network-vif-plugged:2ee7b357-17c9-4ac1-be00-9130e426631c for instance 10269bb5-0ad1-46fb-b4a2-62e573eb2dcd on hv-cinder-81803 Dec 14 03:18:45.555009 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [req-310796dd-a6fd-4932-84a0-f9a00dc926ad req-8a94a1ad-876e-49a9-8a19-7ea70d03a28a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031983 Dec 14 03:18:45.555798 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 282/589] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Dec 14 03:18:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:18:45.620652 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-b9c6e5b9-2156-45ee-9e8f-2c382d6ee999 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:45.627931 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-b9c6e5b9-2156-45ee-9e8f-2c382d6ee999 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef" status: 200 len: 1521 microversion: 2.1 time: 0.155961 Dec 14 03:18:45.628488 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 308/590] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:18:45 2021] GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:18:46.038714 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-afe9ddaa-6c88-4fc8-aea4-964481be0c48 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:46.039359 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-afe9ddaa-6c88-4fc8-aea4-964481be0c48 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:46.045382 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-afe9ddaa-6c88-4fc8-aea4-964481be0c48 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:46.045833 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-afe9ddaa-6c88-4fc8-aea4-964481be0c48 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:46.046604 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-afe9ddaa-6c88-4fc8-aea4-964481be0c48 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:46.047058 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-afe9ddaa-6c88-4fc8-aea4-964481be0c48 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:46.181586 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-afe9ddaa-6c88-4fc8-aea4-964481be0c48 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107444106cda461dab7c403665d92613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:46.189137 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-afe9ddaa-6c88-4fc8-aea4-964481be0c48 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364" status: 200 len: 1722 microversion: 2.1 time: 0.155623 Dec 14 03:18:46.189694 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 283/591] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:18:46 2021] GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:18:46.487316 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-675b75a8-afa7-4b4f-b2c8-f5d8e5af496a tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:46.488930 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-675b75a8-afa7-4b4f-b2c8-f5d8e5af496a tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: 10269bb5-0ad1-46fb-b4a2-62e573eb2dcd] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:46.495000 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-675b75a8-afa7-4b4f-b2c8-f5d8e5af496a tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:46.495485 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-675b75a8-afa7-4b4f-b2c8-f5d8e5af496a tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:46.496275 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-675b75a8-afa7-4b4f-b2c8-f5d8e5af496a tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:46.496713 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-675b75a8-afa7-4b4f-b2c8-f5d8e5af496a tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:46.503850 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-61f16e5b-f446-42c9-ba41-f4a39676e7be tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:46.504457 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-61f16e5b-f446-42c9-ba41-f4a39676e7be tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:46.510065 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-61f16e5b-f446-42c9-ba41-f4a39676e7be tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:46.510513 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-61f16e5b-f446-42c9-ba41-f4a39676e7be tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:46.511306 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-61f16e5b-f446-42c9-ba41-f4a39676e7be tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:46.511737 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-61f16e5b-f446-42c9-ba41-f4a39676e7be tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:46.684981 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-675b75a8-afa7-4b4f-b2c8-f5d8e5af496a tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:46.692134 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-675b75a8-afa7-4b4f-b2c8-f5d8e5af496a tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/10269bb5-0ad1-46fb-b4a2-62e573eb2dcd" status: 200 len: 1317 microversion: 2.1 time: 0.208426 Dec 14 03:18:46.692692 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 309/592] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:18:46 2021] GET /compute/v2.1/servers/10269bb5-0ad1-46fb-b4a2-62e573eb2dcd => generated 1317 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:18:46.696971 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-8385789a-6e62-4754-9b64-a405038c4990 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:46.697566 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-8385789a-6e62-4754-9b64-a405038c4990 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: 4687b559-c95a-4b82-a076-a7468c10ebef] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:46.698450 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-61f16e5b-f446-42c9-ba41-f4a39676e7be tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:46.703187 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8385789a-6e62-4754-9b64-a405038c4990 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:46.703647 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8385789a-6e62-4754-9b64-a405038c4990 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:46.704424 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8385789a-6e62-4754-9b64-a405038c4990 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:46.704834 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8385789a-6e62-4754-9b64-a405038c4990 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:46.706118 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-61f16e5b-f446-42c9-ba41-f4a39676e7be tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:46.708168 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-61f16e5b-f446-42c9-ba41-f4a39676e7be tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:46.709328 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-61f16e5b-f446-42c9-ba41-f4a39676e7be tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1723 microversion: 2.20 time: 0.209098 Dec 14 03:18:46.709873 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 284/593] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:18:46 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1723 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 14 03:18:46.845249 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-8385789a-6e62-4754-9b64-a405038c4990 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:46.853270 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-8385789a-6e62-4754-9b64-a405038c4990 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef" status: 200 len: 1521 microversion: 2.1 time: 0.159645 Dec 14 03:18:46.853843 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 310/594] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:18:46 2021] GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:18:47.206604 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-a2f02bc7-3c6f-4c23-8aa8-7eb6310ec4b5 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:47.207804 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-a2f02bc7-3c6f-4c23-8aa8-7eb6310ec4b5 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:47.213995 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a2f02bc7-3c6f-4c23-8aa8-7eb6310ec4b5 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:47.214449 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a2f02bc7-3c6f-4c23-8aa8-7eb6310ec4b5 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:47.215252 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a2f02bc7-3c6f-4c23-8aa8-7eb6310ec4b5 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:47.215687 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a2f02bc7-3c6f-4c23-8aa8-7eb6310ec4b5 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:47.340390 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-a2f02bc7-3c6f-4c23-8aa8-7eb6310ec4b5 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107444106cda461dab7c403665d92613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:47.347967 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-a2f02bc7-3c6f-4c23-8aa8-7eb6310ec4b5 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364" status: 200 len: 1722 microversion: 2.1 time: 0.144991 Dec 14 03:18:47.348530 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 285/595] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:18:47 2021] GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364 => generated 1722 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:18:47.708629 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-9801f722-8073-49a3-83ae-114157c292d5 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:47.709240 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-9801f722-8073-49a3-83ae-114157c292d5 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: 10269bb5-0ad1-46fb-b4a2-62e573eb2dcd] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:47.715526 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9801f722-8073-49a3-83ae-114157c292d5 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:47.715977 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9801f722-8073-49a3-83ae-114157c292d5 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:47.716747 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9801f722-8073-49a3-83ae-114157c292d5 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:47.717180 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9801f722-8073-49a3-83ae-114157c292d5 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:47.727448 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-8eda2c6e-f159-4d62-a077-90752f88cb81 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:47.728059 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-8eda2c6e-f159-4d62-a077-90752f88cb81 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:47.733820 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-8eda2c6e-f159-4d62-a077-90752f88cb81 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:47.734268 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-8eda2c6e-f159-4d62-a077-90752f88cb81 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:47.735062 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-8eda2c6e-f159-4d62-a077-90752f88cb81 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:47.735506 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-8eda2c6e-f159-4d62-a077-90752f88cb81 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:47.905921 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-9801f722-8073-49a3-83ae-114157c292d5 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:47.912994 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-8eda2c6e-f159-4d62-a077-90752f88cb81 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:47.913600 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-9801f722-8073-49a3-83ae-114157c292d5 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/10269bb5-0ad1-46fb-b4a2-62e573eb2dcd" status: 200 len: 1317 microversion: 2.1 time: 0.208552 Dec 14 03:18:47.914159 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 311/596] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:18:47 2021] GET /compute/v2.1/servers/10269bb5-0ad1-46fb-b4a2-62e573eb2dcd => generated 1317 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:18:47.918289 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-699e77ef-2071-4e9d-96dd-7213a25a4915 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:47.918884 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-699e77ef-2071-4e9d-96dd-7213a25a4915 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: 4687b559-c95a-4b82-a076-a7468c10ebef] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:47.921123 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-8eda2c6e-f159-4d62-a077-90752f88cb81 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:47.922612 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-8eda2c6e-f159-4d62-a077-90752f88cb81 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:47.923845 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-8eda2c6e-f159-4d62-a077-90752f88cb81 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1723 microversion: 2.20 time: 0.200076 Dec 14 03:18:47.924394 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 286/597] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:18:47 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1723 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 14 03:18:47.924523 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-699e77ef-2071-4e9d-96dd-7213a25a4915 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:47.924855 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-699e77ef-2071-4e9d-96dd-7213a25a4915 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:47.926264 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-699e77ef-2071-4e9d-96dd-7213a25a4915 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:47.926701 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-699e77ef-2071-4e9d-96dd-7213a25a4915 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:48.054023 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-699e77ef-2071-4e9d-96dd-7213a25a4915 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:48.061182 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-699e77ef-2071-4e9d-96dd-7213a25a4915 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef" status: 200 len: 1521 microversion: 2.1 time: 0.146096 Dec 14 03:18:48.061736 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 312/598] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:18:47 2021] GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:18:48.364803 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-d3866f71-1710-4893-a961-56e112e2d3e8 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:48.365411 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-d3866f71-1710-4893-a961-56e112e2d3e8 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:48.372168 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-d3866f71-1710-4893-a961-56e112e2d3e8 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:48.372615 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-d3866f71-1710-4893-a961-56e112e2d3e8 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:48.373380 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-d3866f71-1710-4893-a961-56e112e2d3e8 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:48.373810 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-d3866f71-1710-4893-a961-56e112e2d3e8 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:48.499126 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-d3866f71-1710-4893-a961-56e112e2d3e8 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107444106cda461dab7c403665d92613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:48.506738 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-d3866f71-1710-4893-a961-56e112e2d3e8 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364" status: 200 len: 1722 microversion: 2.1 time: 0.145817 Dec 14 03:18:48.507333 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 287/599] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:18:48 2021] GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364 => generated 1722 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:18:48.929976 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-4c15b2b3-6cb7-43dc-a60a-b24d6bff4c80 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:48.930540 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-4c15b2b3-6cb7-43dc-a60a-b24d6bff4c80 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: 10269bb5-0ad1-46fb-b4a2-62e573eb2dcd] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:48.936836 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4c15b2b3-6cb7-43dc-a60a-b24d6bff4c80 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:48.937278 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4c15b2b3-6cb7-43dc-a60a-b24d6bff4c80 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:48.938056 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4c15b2b3-6cb7-43dc-a60a-b24d6bff4c80 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:48.938484 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4c15b2b3-6cb7-43dc-a60a-b24d6bff4c80 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:48.942950 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-e7ff216a-abdb-4117-ba3f-13124dc9177b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:48.943595 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-e7ff216a-abdb-4117-ba3f-13124dc9177b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:48.949316 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-e7ff216a-abdb-4117-ba3f-13124dc9177b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:48.949766 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-e7ff216a-abdb-4117-ba3f-13124dc9177b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:48.950552 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-e7ff216a-abdb-4117-ba3f-13124dc9177b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:48.950991 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-e7ff216a-abdb-4117-ba3f-13124dc9177b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:49.131683 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-4c15b2b3-6cb7-43dc-a60a-b24d6bff4c80 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:49.135004 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-e7ff216a-abdb-4117-ba3f-13124dc9177b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:49.139133 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-4c15b2b3-6cb7-43dc-a60a-b24d6bff4c80 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/10269bb5-0ad1-46fb-b4a2-62e573eb2dcd" status: 200 len: 1508 microversion: 2.1 time: 0.212761 Dec 14 03:18:49.139703 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 313/600] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:18:48 2021] GET /compute/v2.1/servers/10269bb5-0ad1-46fb-b4a2-62e573eb2dcd => generated 1508 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:18:49.142637 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-e7ff216a-abdb-4117-ba3f-13124dc9177b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:49.143931 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-81303eb4-4193-44ab-a7be-9b97a2ee64bc tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:49.144181 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-e7ff216a-abdb-4117-ba3f-13124dc9177b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:49.144565 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-81303eb4-4193-44ab-a7be-9b97a2ee64bc tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: 4687b559-c95a-4b82-a076-a7468c10ebef] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:49.145653 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-e7ff216a-abdb-4117-ba3f-13124dc9177b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1723 microversion: 2.20 time: 0.206809 Dec 14 03:18:49.146452 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 288/601] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:18:48 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1723 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:18:49.158240 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-81303eb4-4193-44ab-a7be-9b97a2ee64bc tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:49.158706 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-81303eb4-4193-44ab-a7be-9b97a2ee64bc tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:49.159658 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-81303eb4-4193-44ab-a7be-9b97a2ee64bc tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:49.159997 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-81303eb4-4193-44ab-a7be-9b97a2ee64bc tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:49.290578 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-81303eb4-4193-44ab-a7be-9b97a2ee64bc tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:49.298052 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-81303eb4-4193-44ab-a7be-9b97a2ee64bc tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef" status: 200 len: 1521 microversion: 2.1 time: 0.157387 Dec 14 03:18:49.298682 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 314/602] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:18:49 2021] GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:18:49.523855 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-bb649d4a-6813-4bb2-945c-b28a63a62645 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:49.524376 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-bb649d4a-6813-4bb2-945c-b28a63a62645 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:49.530743 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-bb649d4a-6813-4bb2-945c-b28a63a62645 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:49.531230 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-bb649d4a-6813-4bb2-945c-b28a63a62645 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:49.532016 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-bb649d4a-6813-4bb2-945c-b28a63a62645 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:49.532454 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-bb649d4a-6813-4bb2-945c-b28a63a62645 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:49.865814 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-bb649d4a-6813-4bb2-945c-b28a63a62645 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107444106cda461dab7c403665d92613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:49.873936 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-bb649d4a-6813-4bb2-945c-b28a63a62645 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364" status: 200 len: 1722 microversion: 2.1 time: 0.353822 Dec 14 03:18:49.874526 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 289/603] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:18:49 2021] GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364 => generated 1722 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:18:50.163985 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-cfb424c1-2bf1-4079-b014-fbfd2e2a735a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:50.164512 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-cfb424c1-2bf1-4079-b014-fbfd2e2a735a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:50.170663 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-cfb424c1-2bf1-4079-b014-fbfd2e2a735a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:50.171138 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-cfb424c1-2bf1-4079-b014-fbfd2e2a735a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:50.171903 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-cfb424c1-2bf1-4079-b014-fbfd2e2a735a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:50.172331 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-cfb424c1-2bf1-4079-b014-fbfd2e2a735a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:50.296532 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-cfb424c1-2bf1-4079-b014-fbfd2e2a735a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:50.304008 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-cfb424c1-2bf1-4079-b014-fbfd2e2a735a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:50.305485 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-cfb424c1-2bf1-4079-b014-fbfd2e2a735a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:50.306614 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-cfb424c1-2bf1-4079-b014-fbfd2e2a735a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1723 microversion: 2.20 time: 0.146393 Dec 14 03:18:50.307182 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 315/604] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:18:50 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1723 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:18:50.315176 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-83b12453-376a-4355-8906-7819ec3ae3d3 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:50.315790 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-83b12453-376a-4355-8906-7819ec3ae3d3 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: 4687b559-c95a-4b82-a076-a7468c10ebef] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:50.322175 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-83b12453-376a-4355-8906-7819ec3ae3d3 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:50.322628 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-83b12453-376a-4355-8906-7819ec3ae3d3 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:50.323451 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-83b12453-376a-4355-8906-7819ec3ae3d3 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:50.323889 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-83b12453-376a-4355-8906-7819ec3ae3d3 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:50.456349 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-83b12453-376a-4355-8906-7819ec3ae3d3 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:50.459960 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-bc70740c-dc36-4f38-9fe1-227321e34fe9 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7b451b7b-4deb-4e04-8b1a-0678037882a2"}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:18:50.461089 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-bc70740c-dc36-4f38-9fe1-227321e34fe9 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: 10269bb5-0ad1-46fb-b4a2-62e573eb2dcd] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:50.463690 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-83b12453-376a-4355-8906-7819ec3ae3d3 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef" status: 200 len: 1521 microversion: 2.1 time: 0.152102 Dec 14 03:18:50.464242 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 290/605] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:18:50 2021] GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:18:50.466927 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-bc70740c-dc36-4f38-9fe1-227321e34fe9 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:50.467415 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-bc70740c-dc36-4f38-9fe1-227321e34fe9 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:50.468192 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-bc70740c-dc36-4f38-9fe1-227321e34fe9 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:50.468906 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-bc70740c-dc36-4f38-9fe1-227321e34fe9 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:50.730714 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-bc70740c-dc36-4f38-9fe1-227321e34fe9 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "POST /compute/v2.1/servers/10269bb5-0ad1-46fb-b4a2-62e573eb2dcd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.274365 Dec 14 03:18:50.731351 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 316/606] 10.222.0.43 () {60 vars in 1322 bytes} [Tue Dec 14 03:18:50 2021] POST /compute/v2.1/servers/10269bb5-0ad1-46fb-b4a2-62e573eb2dcd/os-volume_attachments => generated 194 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:18:50.890503 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-5cc35e03-57b7-4c38-b7bd-8668282a378b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:50.891141 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-5cc35e03-57b7-4c38-b7bd-8668282a378b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:50.897325 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-5cc35e03-57b7-4c38-b7bd-8668282a378b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:50.897770 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-5cc35e03-57b7-4c38-b7bd-8668282a378b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:50.898536 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-5cc35e03-57b7-4c38-b7bd-8668282a378b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:50.898966 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-5cc35e03-57b7-4c38-b7bd-8668282a378b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:51.026175 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-5cc35e03-57b7-4c38-b7bd-8668282a378b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107444106cda461dab7c403665d92613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:51.033956 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-5cc35e03-57b7-4c38-b7bd-8668282a378b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364" status: 200 len: 1722 microversion: 2.1 time: 0.146960 Dec 14 03:18:51.034521 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 291/607] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:18:50 2021] GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364 => generated 1722 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:18:51.326484 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-a669ec2c-c9a6-49b5-bf20-ea1a80c727e6 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:51.327186 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-a669ec2c-c9a6-49b5-bf20-ea1a80c727e6 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:51.333635 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a669ec2c-c9a6-49b5-bf20-ea1a80c727e6 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:51.334078 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a669ec2c-c9a6-49b5-bf20-ea1a80c727e6 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:51.334843 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a669ec2c-c9a6-49b5-bf20-ea1a80c727e6 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:51.335300 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a669ec2c-c9a6-49b5-bf20-ea1a80c727e6 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:51.480834 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-c8f617a7-dd80-406d-96b9-2900a9b2fae2 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:51.481544 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-c8f617a7-dd80-406d-96b9-2900a9b2fae2 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: 4687b559-c95a-4b82-a076-a7468c10ebef] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:51.487528 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c8f617a7-dd80-406d-96b9-2900a9b2fae2 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:51.488494 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c8f617a7-dd80-406d-96b9-2900a9b2fae2 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:51.489467 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c8f617a7-dd80-406d-96b9-2900a9b2fae2 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:51.490076 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c8f617a7-dd80-406d-96b9-2900a9b2fae2 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:51.618403 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-a669ec2c-c9a6-49b5-bf20-ea1a80c727e6 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:51.625945 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-a669ec2c-c9a6-49b5-bf20-ea1a80c727e6 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:51.627457 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-a669ec2c-c9a6-49b5-bf20-ea1a80c727e6 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:51.629147 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-a669ec2c-c9a6-49b5-bf20-ea1a80c727e6 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1744 microversion: 2.20 time: 0.306673 Dec 14 03:18:51.629692 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 317/608] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:18:51 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1744 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:18:51.703241 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-c8f617a7-dd80-406d-96b9-2900a9b2fae2 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57a541b5dc154896bced57a79750a3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4be946dd9b4b2080fb3b398521624e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:51.711008 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-c8f617a7-dd80-406d-96b9-2900a9b2fae2 tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef" status: 200 len: 1521 microversion: 2.1 time: 0.233978 Dec 14 03:18:51.711592 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 292/609] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:18:51 2021] GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef => generated 1521 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 03:18:51.840523 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [req-8fef57ef-7092-4da7-a7ab-fa19c48d6662 req-e8997bcc-bffa-4ed6-843f-5c6053b98c3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4687b559-c95a-4b82-a076-a7468c10ebef", "name": "network-vif-deleted", "tag": "9d0f1802-5b85-4dd7-847f-3cdd0b182adf"}]} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:18:51.842065 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:18:51.842065 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: warnings.warn(msg) Dec 14 03:18:51.849770 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-8fef57ef-7092-4da7-a7ab-fa19c48d6662 req-e8997bcc-bffa-4ed6-843f-5c6053b98c3f service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:51.850178 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-8fef57ef-7092-4da7-a7ab-fa19c48d6662 req-e8997bcc-bffa-4ed6-843f-5c6053b98c3f service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:51.861460 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.compute.server_external_events [req-8fef57ef-7092-4da7-a7ab-fa19c48d6662 req-e8997bcc-bffa-4ed6-843f-5c6053b98c3f service nova] Creating event network-vif-deleted:9d0f1802-5b85-4dd7-847f-3cdd0b182adf for instance 4687b559-c95a-4b82-a076-a7468c10ebef on hv-cinder-81803 Dec 14 03:18:51.866476 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [req-8fef57ef-7092-4da7-a7ab-fa19c48d6662 req-e8997bcc-bffa-4ed6-843f-5c6053b98c3f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029452 Dec 14 03:18:51.867416 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 318/610] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Dec 14 03:18:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:18:52.051614 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-8e7f4756-9a82-409e-9531-164e063deea9 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:52.052148 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-8e7f4756-9a82-409e-9531-164e063deea9 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:52.058350 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-8e7f4756-9a82-409e-9531-164e063deea9 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:52.058810 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-8e7f4756-9a82-409e-9531-164e063deea9 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:52.059645 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-8e7f4756-9a82-409e-9531-164e063deea9 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:52.060088 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-8e7f4756-9a82-409e-9531-164e063deea9 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:52.185635 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-8e7f4756-9a82-409e-9531-164e063deea9 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107444106cda461dab7c403665d92613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:52.193881 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-8e7f4756-9a82-409e-9531-164e063deea9 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364" status: 200 len: 1722 microversion: 2.1 time: 0.146558 Dec 14 03:18:52.194438 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 293/611] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:18:52 2021] GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364 => generated 1722 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:18:52.649893 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-3b24a8cb-44ba-4c9d-af36-a2dd31c82c99 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:52.650527 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-3b24a8cb-44ba-4c9d-af36-a2dd31c82c99 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:52.656597 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3b24a8cb-44ba-4c9d-af36-a2dd31c82c99 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:52.657106 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3b24a8cb-44ba-4c9d-af36-a2dd31c82c99 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:52.657893 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3b24a8cb-44ba-4c9d-af36-a2dd31c82c99 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:52.658330 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3b24a8cb-44ba-4c9d-af36-a2dd31c82c99 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:52.729133 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-7919c1bd-d415-4d82-9f02-5e783574b4da tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:52.729749 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-7919c1bd-d415-4d82-9f02-5e783574b4da tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] [instance: 4687b559-c95a-4b82-a076-a7468c10ebef] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:52.735449 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-7919c1bd-d415-4d82-9f02-5e783574b4da tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:52.735908 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-7919c1bd-d415-4d82-9f02-5e783574b4da tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:52.736700 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-7919c1bd-d415-4d82-9f02-5e783574b4da tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:52.737152 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-7919c1bd-d415-4d82-9f02-5e783574b4da tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:52.750394 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.wsgi [None req-7919c1bd-d415-4d82-9f02-5e783574b4da tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] HTTP exception thrown: Instance 4687b559-c95a-4b82-a076-a7468c10ebef could not be found. Dec 14 03:18:52.750990 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-7919c1bd-d415-4d82-9f02-5e783574b4da tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] Returning 404 to user: Instance 4687b559-c95a-4b82-a076-a7468c10ebef could not be found. {{(pid=116071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 03:18:52.751837 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-7919c1bd-d415-4d82-9f02-5e783574b4da tempest-ServerRescueNegativeTestJSON-441391956 tempest-ServerRescueNegativeTestJSON-441391956-project] 10.222.0.43 "GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef" status: 404 len: 111 microversion: 2.1 time: 0.026435 Dec 14 03:18:52.752383 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 294/612] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:18:52 2021] GET /compute/v2.1/servers/4687b559-c95a-4b82-a076-a7468c10ebef => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 14 03:18:52.789616 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-3b24a8cb-44ba-4c9d-af36-a2dd31c82c99 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:52.797458 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-3b24a8cb-44ba-4c9d-af36-a2dd31c82c99 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:52.799058 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-3b24a8cb-44ba-4c9d-af36-a2dd31c82c99 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:52.800211 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-3b24a8cb-44ba-4c9d-af36-a2dd31c82c99 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1744 microversion: 2.20 time: 0.154906 Dec 14 03:18:52.800762 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 319/613] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:18:52 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1744 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:18:53.211623 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-97b5a17b-058a-4811-b0b9-281f9da3b1e0 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:53.212244 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-97b5a17b-058a-4811-b0b9-281f9da3b1e0 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:53.218722 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-97b5a17b-058a-4811-b0b9-281f9da3b1e0 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:53.219220 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-97b5a17b-058a-4811-b0b9-281f9da3b1e0 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:53.220031 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-97b5a17b-058a-4811-b0b9-281f9da3b1e0 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:53.220478 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-97b5a17b-058a-4811-b0b9-281f9da3b1e0 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:53.355789 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-97b5a17b-058a-4811-b0b9-281f9da3b1e0 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107444106cda461dab7c403665d92613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:53.363753 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-97b5a17b-058a-4811-b0b9-281f9da3b1e0 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364" status: 200 len: 1722 microversion: 2.1 time: 0.155809 Dec 14 03:18:53.364321 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 295/614] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:18:53 2021] GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:18:53.818938 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-500e7afd-703a-4ec9-b132-1e09b162ab48 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:53.820181 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-500e7afd-703a-4ec9-b132-1e09b162ab48 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:53.826365 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-500e7afd-703a-4ec9-b132-1e09b162ab48 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:53.826810 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-500e7afd-703a-4ec9-b132-1e09b162ab48 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:53.827624 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-500e7afd-703a-4ec9-b132-1e09b162ab48 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:53.828050 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-500e7afd-703a-4ec9-b132-1e09b162ab48 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:53.979985 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-500e7afd-703a-4ec9-b132-1e09b162ab48 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:53.989184 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-500e7afd-703a-4ec9-b132-1e09b162ab48 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:53.990968 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-500e7afd-703a-4ec9-b132-1e09b162ab48 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:53.992396 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-500e7afd-703a-4ec9-b132-1e09b162ab48 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1744 microversion: 2.20 time: 0.177225 Dec 14 03:18:53.992953 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 320/615] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:18:53 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1744 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:18:54.381123 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-b62cd887-ac26-47ab-baeb-d53ec303903f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:54.381803 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-b62cd887-ac26-47ab-baeb-d53ec303903f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:54.388533 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b62cd887-ac26-47ab-baeb-d53ec303903f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:54.388994 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b62cd887-ac26-47ab-baeb-d53ec303903f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:54.390404 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b62cd887-ac26-47ab-baeb-d53ec303903f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:54.390853 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b62cd887-ac26-47ab-baeb-d53ec303903f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:54.540579 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-b62cd887-ac26-47ab-baeb-d53ec303903f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107444106cda461dab7c403665d92613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:54.552652 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-b62cd887-ac26-47ab-baeb-d53ec303903f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364" status: 200 len: 1722 microversion: 2.1 time: 0.175555 Dec 14 03:18:54.562771 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 296/616] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:18:54 2021] GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364 => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:18:55.010538 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-a75f7ed7-1462-43d6-aec0-cc8cd56b7ed8 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:55.011253 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-a75f7ed7-1462-43d6-aec0-cc8cd56b7ed8 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:55.021142 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a75f7ed7-1462-43d6-aec0-cc8cd56b7ed8 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:55.021889 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a75f7ed7-1462-43d6-aec0-cc8cd56b7ed8 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:55.023156 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a75f7ed7-1462-43d6-aec0-cc8cd56b7ed8 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:55.023789 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a75f7ed7-1462-43d6-aec0-cc8cd56b7ed8 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:55.166119 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-a75f7ed7-1462-43d6-aec0-cc8cd56b7ed8 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:55.174691 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-a75f7ed7-1462-43d6-aec0-cc8cd56b7ed8 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:55.176302 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-a75f7ed7-1462-43d6-aec0-cc8cd56b7ed8 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:55.177474 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-a75f7ed7-1462-43d6-aec0-cc8cd56b7ed8 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1744 microversion: 2.20 time: 0.170524 Dec 14 03:18:55.178035 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 321/617] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:18:55 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1744 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:18:55.570039 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-1f833963-0b20-413b-b8ed-9cf47b599bd4 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:55.571292 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-1f833963-0b20-413b-b8ed-9cf47b599bd4 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:55.578090 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-1f833963-0b20-413b-b8ed-9cf47b599bd4 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:55.578541 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-1f833963-0b20-413b-b8ed-9cf47b599bd4 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:55.579363 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-1f833963-0b20-413b-b8ed-9cf47b599bd4 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:55.579799 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-1f833963-0b20-413b-b8ed-9cf47b599bd4 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:55.617030 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [req-d8b38b43-0705-418c-95c3-15ec5ef38c9f req-109019f8-1f4d-45a8-ba95-14f592feda01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86395107-d320-45d8-83de-f1848858be10", "name": "network-vif-plugged", "status": "completed", "tag": "85ceb16f-0c27-48e9-ab76-5cd49eb12802"}]} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:18:55.619908 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:18:55.619908 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: warnings.warn(msg) Dec 14 03:18:55.635991 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-d8b38b43-0705-418c-95c3-15ec5ef38c9f req-109019f8-1f4d-45a8-ba95-14f592feda01 service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:55.636656 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-d8b38b43-0705-418c-95c3-15ec5ef38c9f req-109019f8-1f4d-45a8-ba95-14f592feda01 service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:55.652644 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.compute.server_external_events [req-d8b38b43-0705-418c-95c3-15ec5ef38c9f req-109019f8-1f4d-45a8-ba95-14f592feda01 service nova] Creating event network-vif-plugged:85ceb16f-0c27-48e9-ab76-5cd49eb12802 for instance 86395107-d320-45d8-83de-f1848858be10 on hv-cinder-81803 Dec 14 03:18:55.659315 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [req-d8b38b43-0705-418c-95c3-15ec5ef38c9f req-109019f8-1f4d-45a8-ba95-14f592feda01 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049657 Dec 14 03:18:55.660479 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 322/618] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Dec 14 03:18:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:18:55.728599 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-1f833963-0b20-413b-b8ed-9cf47b599bd4 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107444106cda461dab7c403665d92613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:55.736603 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-1f833963-0b20-413b-b8ed-9cf47b599bd4 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364" status: 200 len: 1722 microversion: 2.1 time: 0.170671 Dec 14 03:18:55.737219 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 297/619] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:18:55 2021] GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:18:56.196764 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-4814cb1e-390a-4dc1-a457-ebd7bb5beb21 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:56.197473 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-4814cb1e-390a-4dc1-a457-ebd7bb5beb21 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:56.204259 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4814cb1e-390a-4dc1-a457-ebd7bb5beb21 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:56.204718 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4814cb1e-390a-4dc1-a457-ebd7bb5beb21 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:56.205501 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4814cb1e-390a-4dc1-a457-ebd7bb5beb21 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:56.205942 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4814cb1e-390a-4dc1-a457-ebd7bb5beb21 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:56.346268 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-4814cb1e-390a-4dc1-a457-ebd7bb5beb21 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:56.354498 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-4814cb1e-390a-4dc1-a457-ebd7bb5beb21 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:56.356028 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-4814cb1e-390a-4dc1-a457-ebd7bb5beb21 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:56.357176 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-4814cb1e-390a-4dc1-a457-ebd7bb5beb21 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1744 microversion: 2.20 time: 0.164949 Dec 14 03:18:56.357739 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 323/620] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:18:56 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1744 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:18:56.754436 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-d94066ea-b558-4c5f-8dd9-2d3e5787e30a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:56.755166 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-d94066ea-b558-4c5f-8dd9-2d3e5787e30a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:56.761373 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-d94066ea-b558-4c5f-8dd9-2d3e5787e30a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:56.761759 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-d94066ea-b558-4c5f-8dd9-2d3e5787e30a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:56.762540 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-d94066ea-b558-4c5f-8dd9-2d3e5787e30a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:56.762978 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-d94066ea-b558-4c5f-8dd9-2d3e5787e30a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:56.895746 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-d94066ea-b558-4c5f-8dd9-2d3e5787e30a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107444106cda461dab7c403665d92613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:56.903417 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-d94066ea-b558-4c5f-8dd9-2d3e5787e30a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364" status: 200 len: 1722 microversion: 2.1 time: 0.152520 Dec 14 03:18:56.903974 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 298/621] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:18:56 2021] GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:18:57.377881 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-2107fcff-8d1a-430b-9aa2-f90191d2a618 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:57.379856 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-2107fcff-8d1a-430b-9aa2-f90191d2a618 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:57.395276 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2107fcff-8d1a-430b-9aa2-f90191d2a618 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:57.395732 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2107fcff-8d1a-430b-9aa2-f90191d2a618 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:57.396519 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2107fcff-8d1a-430b-9aa2-f90191d2a618 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:57.396958 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2107fcff-8d1a-430b-9aa2-f90191d2a618 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:57.530020 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-2107fcff-8d1a-430b-9aa2-f90191d2a618 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:57.538272 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-2107fcff-8d1a-430b-9aa2-f90191d2a618 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:57.539831 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-2107fcff-8d1a-430b-9aa2-f90191d2a618 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:57.540987 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-2107fcff-8d1a-430b-9aa2-f90191d2a618 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1744 microversion: 2.20 time: 0.166913 Dec 14 03:18:57.541533 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 324/622] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:18:57 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1744 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:18:57.920180 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-b042918b-9448-4c61-8e5e-a7bb16156f6b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:57.920794 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-b042918b-9448-4c61-8e5e-a7bb16156f6b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:57.926929 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b042918b-9448-4c61-8e5e-a7bb16156f6b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:57.927417 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b042918b-9448-4c61-8e5e-a7bb16156f6b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:57.928267 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b042918b-9448-4c61-8e5e-a7bb16156f6b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:57.928708 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b042918b-9448-4c61-8e5e-a7bb16156f6b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:58.061647 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-b042918b-9448-4c61-8e5e-a7bb16156f6b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107444106cda461dab7c403665d92613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:58.069443 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-b042918b-9448-4c61-8e5e-a7bb16156f6b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364" status: 200 len: 1722 microversion: 2.1 time: 0.152940 Dec 14 03:18:58.070022 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 299/623] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:18:57 2021] GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:18:58.307499 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-21a9c473-9de0-4638-86b5-b184f22afd12 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:58.307987 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-21a9c473-9de0-4638-86b5-b184f22afd12 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: 10269bb5-0ad1-46fb-b4a2-62e573eb2dcd] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:58.313636 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-21a9c473-9de0-4638-86b5-b184f22afd12 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:58.314078 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-21a9c473-9de0-4638-86b5-b184f22afd12 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:58.314840 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-21a9c473-9de0-4638-86b5-b184f22afd12 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:58.315294 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-21a9c473-9de0-4638-86b5-b184f22afd12 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:58.391190 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.objects.instance [None req-21a9c473-9de0-4638-86b5-b184f22afd12 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lazy-loading 'services' on Instance uuid 10269bb5-0ad1-46fb-b4a2-62e573eb2dcd {{(pid=116072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 14 03:18:58.458211 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-21a9c473-9de0-4638-86b5-b184f22afd12 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "DELETE /compute/v2.1/servers/10269bb5-0ad1-46fb-b4a2-62e573eb2dcd/os-volume_attachments/7b451b7b-4deb-4e04-8b1a-0678037882a2" status: 202 len: 0 microversion: 2.1 time: 0.154103 Dec 14 03:18:58.458787 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 325/624] 10.222.0.43 () {58 vars in 1415 bytes} [Tue Dec 14 03:18:58 2021] DELETE /compute/v2.1/servers/10269bb5-0ad1-46fb-b4a2-62e573eb2dcd/os-volume_attachments/7b451b7b-4deb-4e04-8b1a-0678037882a2 => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:18:58.466848 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-ae8eb736-9fe1-4b73-b50b-65da619cdc3c tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:58.467845 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-ae8eb736-9fe1-4b73-b50b-65da619cdc3c tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: 10269bb5-0ad1-46fb-b4a2-62e573eb2dcd] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:58.474170 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ae8eb736-9fe1-4b73-b50b-65da619cdc3c tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:58.474621 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ae8eb736-9fe1-4b73-b50b-65da619cdc3c tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:58.475429 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ae8eb736-9fe1-4b73-b50b-65da619cdc3c tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:58.475867 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ae8eb736-9fe1-4b73-b50b-65da619cdc3c tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:58.504630 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-ae8eb736-9fe1-4b73-b50b-65da619cdc3c tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/10269bb5-0ad1-46fb-b4a2-62e573eb2dcd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041395 Dec 14 03:18:58.505161 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 300/625] 10.222.0.43 () {58 vars in 1301 bytes} [Tue Dec 14 03:18:58 2021] GET /compute/v2.1/servers/10269bb5-0ad1-46fb-b4a2-62e573eb2dcd/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:18:58.560599 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-e19fbadb-7235-42f9-ba0e-47895133377b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:58.561351 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-e19fbadb-7235-42f9-ba0e-47895133377b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:58.567693 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e19fbadb-7235-42f9-ba0e-47895133377b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:58.568147 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e19fbadb-7235-42f9-ba0e-47895133377b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:58.568927 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e19fbadb-7235-42f9-ba0e-47895133377b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:58.569359 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e19fbadb-7235-42f9-ba0e-47895133377b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:58.715697 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-e19fbadb-7235-42f9-ba0e-47895133377b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:58.726977 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-e19fbadb-7235-42f9-ba0e-47895133377b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:58.728664 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-e19fbadb-7235-42f9-ba0e-47895133377b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:58.729859 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-e19fbadb-7235-42f9-ba0e-47895133377b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1739 microversion: 2.20 time: 0.173462 Dec 14 03:18:58.730718 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 326/626] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:18:58 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1739 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:18:59.086929 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-aeffee3b-e346-41bb-bef5-d62b356b836c tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:59.087613 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-aeffee3b-e346-41bb-bef5-d62b356b836c tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:59.095426 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-aeffee3b-e346-41bb-bef5-d62b356b836c tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:59.096231 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-aeffee3b-e346-41bb-bef5-d62b356b836c tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:59.097146 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-aeffee3b-e346-41bb-bef5-d62b356b836c tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:59.097675 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-aeffee3b-e346-41bb-bef5-d62b356b836c tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:59.243451 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-aeffee3b-e346-41bb-bef5-d62b356b836c tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107444106cda461dab7c403665d92613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:59.253810 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-aeffee3b-e346-41bb-bef5-d62b356b836c tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364" status: 200 len: 1699 microversion: 2.1 time: 0.170000 Dec 14 03:18:59.254885 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 301/627] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:18:59 2021] GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364 => generated 1699 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:18:59.271638 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-48004bc9-d195-452d-80d2-aa9f43117324 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:18:59.282576 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-48004bc9-d195-452d-80d2-aa9f43117324 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:59.284092 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-48004bc9-d195-452d-80d2-aa9f43117324 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:59.314858 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-48004bc9-d195-452d-80d2-aa9f43117324 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Going to try to start instance {{(pid=116072) start /opt/stack/nova/nova/compute/api.py:2677}} Dec 14 03:18:59.362189 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-48004bc9-d195-452d-80d2-aa9f43117324 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action" status: 202 len: 0 microversion: 2.1 time: 0.095514 Dec 14 03:18:59.363405 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 327/628] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:18:59 2021] POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:18:59.372317 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-b7588111-db1f-4a8d-aaed-38b20d94ce1f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:59.373079 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-b7588111-db1f-4a8d-aaed-38b20d94ce1f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:59.381219 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b7588111-db1f-4a8d-aaed-38b20d94ce1f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:59.382867 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b7588111-db1f-4a8d-aaed-38b20d94ce1f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:59.384407 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b7588111-db1f-4a8d-aaed-38b20d94ce1f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:59.385851 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b7588111-db1f-4a8d-aaed-38b20d94ce1f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:59.541212 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-1d1cd6c9-41ec-41a9-92ad-af0d394eccc2 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:59.543023 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-1d1cd6c9-41ec-41a9-92ad-af0d394eccc2 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: 10269bb5-0ad1-46fb-b4a2-62e573eb2dcd] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:59.567218 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1d1cd6c9-41ec-41a9-92ad-af0d394eccc2 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:59.568122 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1d1cd6c9-41ec-41a9-92ad-af0d394eccc2 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:59.569206 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1d1cd6c9-41ec-41a9-92ad-af0d394eccc2 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:59.569860 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1d1cd6c9-41ec-41a9-92ad-af0d394eccc2 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:59.610265 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-1d1cd6c9-41ec-41a9-92ad-af0d394eccc2 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/10269bb5-0ad1-46fb-b4a2-62e573eb2dcd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092412 Dec 14 03:18:59.616299 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 328/629] 10.222.0.43 () {58 vars in 1301 bytes} [Tue Dec 14 03:18:59 2021] GET /compute/v2.1/servers/10269bb5-0ad1-46fb-b4a2-62e573eb2dcd/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:18:59.633511 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-b7588111-db1f-4a8d-aaed-38b20d94ce1f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107444106cda461dab7c403665d92613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:18:59.658998 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-b7588111-db1f-4a8d-aaed-38b20d94ce1f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364" status: 200 len: 1708 microversion: 2.1 time: 0.290406 Dec 14 03:18:59.670358 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 302/630] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:18:59 2021] GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364 => generated 1708 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:18:59.748966 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-6987ebf6-a1b1-40e4-8184-2f940ea0e9b8 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:18:59.749513 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-6987ebf6-a1b1-40e4-8184-2f940ea0e9b8 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:18:59.757182 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6987ebf6-a1b1-40e4-8184-2f940ea0e9b8 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:59.758252 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6987ebf6-a1b1-40e4-8184-2f940ea0e9b8 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:18:59.759150 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6987ebf6-a1b1-40e4-8184-2f940ea0e9b8 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:18:59.759749 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6987ebf6-a1b1-40e4-8184-2f940ea0e9b8 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:00.000893 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-6987ebf6-a1b1-40e4-8184-2f940ea0e9b8 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:00.010975 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-6987ebf6-a1b1-40e4-8184-2f940ea0e9b8 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:00.013536 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-6987ebf6-a1b1-40e4-8184-2f940ea0e9b8 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:00.015000 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-6987ebf6-a1b1-40e4-8184-2f940ea0e9b8 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1739 microversion: 2.20 time: 0.269802 Dec 14 03:19:00.016183 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 329/631] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:18:59 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1739 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:19:00.622851 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-01bc6a48-6ac9-43bd-91c4-9daed390b8fd tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:00.623889 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-01bc6a48-6ac9-43bd-91c4-9daed390b8fd tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: 10269bb5-0ad1-46fb-b4a2-62e573eb2dcd] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:00.631076 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-01bc6a48-6ac9-43bd-91c4-9daed390b8fd tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:00.631768 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-01bc6a48-6ac9-43bd-91c4-9daed390b8fd tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:00.632765 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-01bc6a48-6ac9-43bd-91c4-9daed390b8fd tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:00.633501 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-01bc6a48-6ac9-43bd-91c4-9daed390b8fd tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:00.676820 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-d975cb2d-22b6-415b-a5e7-a29fbd7d2093 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:00.677357 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-01bc6a48-6ac9-43bd-91c4-9daed390b8fd tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/10269bb5-0ad1-46fb-b4a2-62e573eb2dcd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057877 Dec 14 03:19:00.677678 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-d975cb2d-22b6-415b-a5e7-a29fbd7d2093 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:00.682619 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 303/632] 10.222.0.43 () {58 vars in 1301 bytes} [Tue Dec 14 03:19:00 2021] GET /compute/v2.1/servers/10269bb5-0ad1-46fb-b4a2-62e573eb2dcd/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 14 03:19:00.685926 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d975cb2d-22b6-415b-a5e7-a29fbd7d2093 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:00.686385 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d975cb2d-22b6-415b-a5e7-a29fbd7d2093 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:00.687214 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d975cb2d-22b6-415b-a5e7-a29fbd7d2093 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:00.687748 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d975cb2d-22b6-415b-a5e7-a29fbd7d2093 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:00.939766 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-d975cb2d-22b6-415b-a5e7-a29fbd7d2093 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107444106cda461dab7c403665d92613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:00.948278 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-d975cb2d-22b6-415b-a5e7-a29fbd7d2093 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364" status: 200 len: 1708 microversion: 2.1 time: 0.275433 Dec 14 03:19:00.948862 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 330/633] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:19:00 2021] GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364 => generated 1708 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:19:01.035274 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-c55580f3-a129-4feb-8fac-87e9da33f438 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:01.036414 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-c55580f3-a129-4feb-8fac-87e9da33f438 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:01.044256 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c55580f3-a129-4feb-8fac-87e9da33f438 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:01.045743 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c55580f3-a129-4feb-8fac-87e9da33f438 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:01.048822 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c55580f3-a129-4feb-8fac-87e9da33f438 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:01.050952 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c55580f3-a129-4feb-8fac-87e9da33f438 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:01.230195 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-c55580f3-a129-4feb-8fac-87e9da33f438 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:01.254605 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-c55580f3-a129-4feb-8fac-87e9da33f438 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:01.261461 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-c55580f3-a129-4feb-8fac-87e9da33f438 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:01.264073 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-c55580f3-a129-4feb-8fac-87e9da33f438 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1739 microversion: 2.20 time: 0.233142 Dec 14 03:19:01.269168 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 304/634] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:19:01 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1739 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:19:01.964670 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-3f0a20ac-bbbc-455f-b25f-a2d2cb4e3ca8 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:01.970264 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-02ccdda5-6dcc-4e7b-b635-9472c5ddba24 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:01.971427 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-02ccdda5-6dcc-4e7b-b635-9472c5ddba24 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: 10269bb5-0ad1-46fb-b4a2-62e573eb2dcd] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:01.973008 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-3f0a20ac-bbbc-455f-b25f-a2d2cb4e3ca8 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:01.984040 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-02ccdda5-6dcc-4e7b-b635-9472c5ddba24 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:01.986703 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-02ccdda5-6dcc-4e7b-b635-9472c5ddba24 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:01.988235 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-02ccdda5-6dcc-4e7b-b635-9472c5ddba24 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:01.988951 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-02ccdda5-6dcc-4e7b-b635-9472c5ddba24 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:01.990027 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-3f0a20ac-bbbc-455f-b25f-a2d2cb4e3ca8 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:01.992827 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-3f0a20ac-bbbc-455f-b25f-a2d2cb4e3ca8 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:01.993727 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-3f0a20ac-bbbc-455f-b25f-a2d2cb4e3ca8 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:01.994179 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-3f0a20ac-bbbc-455f-b25f-a2d2cb4e3ca8 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:02.031401 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-02ccdda5-6dcc-4e7b-b635-9472c5ddba24 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: 10269bb5-0ad1-46fb-b4a2-62e573eb2dcd] Going to try to terminate instance {{(pid=116072) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 14 03:19:02.155650 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-02ccdda5-6dcc-4e7b-b635-9472c5ddba24 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "DELETE /compute/v2.1/servers/10269bb5-0ad1-46fb-b4a2-62e573eb2dcd" status: 204 len: 0 microversion: 2.1 time: 0.188732 Dec 14 03:19:02.159813 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 331/635] 10.222.0.43 () {58 vars in 1238 bytes} [Tue Dec 14 03:19:01 2021] DELETE /compute/v2.1/servers/10269bb5-0ad1-46fb-b4a2-62e573eb2dcd => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 14 03:19:02.168633 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-bad0ff25-5815-4cba-bdd7-73cd3670b65f tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:02.175700 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-bad0ff25-5815-4cba-bdd7-73cd3670b65f tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: 10269bb5-0ad1-46fb-b4a2-62e573eb2dcd] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:02.183778 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-bad0ff25-5815-4cba-bdd7-73cd3670b65f tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:02.185116 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-bad0ff25-5815-4cba-bdd7-73cd3670b65f tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:02.186417 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-bad0ff25-5815-4cba-bdd7-73cd3670b65f tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:02.187110 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-bad0ff25-5815-4cba-bdd7-73cd3670b65f tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:02.204352 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-3f0a20ac-bbbc-455f-b25f-a2d2cb4e3ca8 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107444106cda461dab7c403665d92613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:02.214640 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-3f0a20ac-bbbc-455f-b25f-a2d2cb4e3ca8 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364" status: 200 len: 1712 microversion: 2.1 time: 0.253535 Dec 14 03:19:02.215572 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 305/636] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:19:01 2021] GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364 => generated 1712 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:19:02.285903 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-f6da034e-3c5f-42d8-bec8-8cf49fec3ed1 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:02.286528 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-f6da034e-3c5f-42d8-bec8-8cf49fec3ed1 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:02.295361 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-f6da034e-3c5f-42d8-bec8-8cf49fec3ed1 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:02.295361 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-f6da034e-3c5f-42d8-bec8-8cf49fec3ed1 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:02.298186 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-f6da034e-3c5f-42d8-bec8-8cf49fec3ed1 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:02.298654 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-f6da034e-3c5f-42d8-bec8-8cf49fec3ed1 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:02.420329 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-bad0ff25-5815-4cba-bdd7-73cd3670b65f tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:02.429624 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-bad0ff25-5815-4cba-bdd7-73cd3670b65f tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/10269bb5-0ad1-46fb-b4a2-62e573eb2dcd" status: 200 len: 1514 microversion: 2.1 time: 0.265224 Dec 14 03:19:02.430259 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 332/637] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:19:02 2021] GET /compute/v2.1/servers/10269bb5-0ad1-46fb-b4a2-62e573eb2dcd => generated 1514 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:19:02.507115 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-f6da034e-3c5f-42d8-bec8-8cf49fec3ed1 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:02.518188 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-f6da034e-3c5f-42d8-bec8-8cf49fec3ed1 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:02.520431 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-f6da034e-3c5f-42d8-bec8-8cf49fec3ed1 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:02.521611 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-f6da034e-3c5f-42d8-bec8-8cf49fec3ed1 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1739 microversion: 2.20 time: 0.240252 Dec 14 03:19:02.522162 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 306/638] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:19:02 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1739 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 14 03:19:03.450330 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-f1291f1f-4d94-4345-a1ea-37c886692b7c tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:03.452278 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-f1291f1f-4d94-4345-a1ea-37c886692b7c tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: 10269bb5-0ad1-46fb-b4a2-62e573eb2dcd] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:03.462943 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f1291f1f-4d94-4345-a1ea-37c886692b7c tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:03.464056 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f1291f1f-4d94-4345-a1ea-37c886692b7c tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:03.465101 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f1291f1f-4d94-4345-a1ea-37c886692b7c tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:03.466014 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f1291f1f-4d94-4345-a1ea-37c886692b7c tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:03.541665 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-0b089e9c-15f9-4385-845e-1e36e7d4168c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:03.542243 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-0b089e9c-15f9-4385-845e-1e36e7d4168c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:03.552540 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-0b089e9c-15f9-4385-845e-1e36e7d4168c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:03.555660 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-0b089e9c-15f9-4385-845e-1e36e7d4168c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:03.556684 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-0b089e9c-15f9-4385-845e-1e36e7d4168c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:03.557299 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-0b089e9c-15f9-4385-845e-1e36e7d4168c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:03.675966 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-f1291f1f-4d94-4345-a1ea-37c886692b7c tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:03.686356 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-f1291f1f-4d94-4345-a1ea-37c886692b7c tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/10269bb5-0ad1-46fb-b4a2-62e573eb2dcd" status: 200 len: 1514 microversion: 2.1 time: 0.241199 Dec 14 03:19:03.689754 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 333/639] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:19:03 2021] GET /compute/v2.1/servers/10269bb5-0ad1-46fb-b4a2-62e573eb2dcd => generated 1514 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:19:03.781370 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-0b089e9c-15f9-4385-845e-1e36e7d4168c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:03.790400 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-0b089e9c-15f9-4385-845e-1e36e7d4168c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:03.792256 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-0b089e9c-15f9-4385-845e-1e36e7d4168c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:03.793711 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-0b089e9c-15f9-4385-845e-1e36e7d4168c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1739 microversion: 2.20 time: 0.256462 Dec 14 03:19:03.796040 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 307/640] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:19:03 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1739 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:19:04.707620 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-27efb32c-8433-4f9a-ac9b-53bc68b890ab tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:04.708527 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-27efb32c-8433-4f9a-ac9b-53bc68b890ab tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: 10269bb5-0ad1-46fb-b4a2-62e573eb2dcd] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:04.714961 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-27efb32c-8433-4f9a-ac9b-53bc68b890ab tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:04.715766 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-27efb32c-8433-4f9a-ac9b-53bc68b890ab tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:04.716852 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-27efb32c-8433-4f9a-ac9b-53bc68b890ab tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:04.717389 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-27efb32c-8433-4f9a-ac9b-53bc68b890ab tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:04.813234 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-2b266b34-7c62-4b69-8e26-1af9e8a0c60d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:04.813848 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-2b266b34-7c62-4b69-8e26-1af9e8a0c60d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:04.821174 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-2b266b34-7c62-4b69-8e26-1af9e8a0c60d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:04.821870 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-2b266b34-7c62-4b69-8e26-1af9e8a0c60d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:04.822850 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-2b266b34-7c62-4b69-8e26-1af9e8a0c60d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:04.823493 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-2b266b34-7c62-4b69-8e26-1af9e8a0c60d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:05.028400 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-27efb32c-8433-4f9a-ac9b-53bc68b890ab tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:05.036985 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-27efb32c-8433-4f9a-ac9b-53bc68b890ab tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/10269bb5-0ad1-46fb-b4a2-62e573eb2dcd" status: 200 len: 1514 microversion: 2.1 time: 0.333086 Dec 14 03:19:05.038041 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 334/641] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:19:04 2021] GET /compute/v2.1/servers/10269bb5-0ad1-46fb-b4a2-62e573eb2dcd => generated 1514 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:19:05.116882 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-2b266b34-7c62-4b69-8e26-1af9e8a0c60d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:05.137259 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-2b266b34-7c62-4b69-8e26-1af9e8a0c60d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:05.142913 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-2b266b34-7c62-4b69-8e26-1af9e8a0c60d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:05.145051 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-2b266b34-7c62-4b69-8e26-1af9e8a0c60d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1739 microversion: 2.20 time: 0.335659 Dec 14 03:19:05.147133 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 308/642] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:19:04 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1739 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 14 03:19:05.385613 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [req-15fee516-7897-4219-8271-83de0884b75b req-4c93fce8-1bc9-41e5-a9d8-f68b2e86b8dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10269bb5-0ad1-46fb-b4a2-62e573eb2dcd", "name": "network-vif-deleted", "tag": "2ee7b357-17c9-4ac1-be00-9130e426631c"}]} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:19:05.387399 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:19:05.387399 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: warnings.warn(msg) Dec 14 03:19:05.397730 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-15fee516-7897-4219-8271-83de0884b75b req-4c93fce8-1bc9-41e5-a9d8-f68b2e86b8dd service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:05.408658 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-15fee516-7897-4219-8271-83de0884b75b req-4c93fce8-1bc9-41e5-a9d8-f68b2e86b8dd service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:05.427876 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.compute.server_external_events [req-15fee516-7897-4219-8271-83de0884b75b req-4c93fce8-1bc9-41e5-a9d8-f68b2e86b8dd service nova] Creating event network-vif-deleted:2ee7b357-17c9-4ac1-be00-9130e426631c for instance 10269bb5-0ad1-46fb-b4a2-62e573eb2dcd on hv-cinder-81803 Dec 14 03:19:05.433761 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [req-15fee516-7897-4219-8271-83de0884b75b req-4c93fce8-1bc9-41e5-a9d8-f68b2e86b8dd service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053067 Dec 14 03:19:05.434852 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 335/643] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Dec 14 03:19:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:19:06.056094 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-2607f5a8-8d77-43e1-b6d6-bb3ab343d116 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:06.056711 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-2607f5a8-8d77-43e1-b6d6-bb3ab343d116 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: 10269bb5-0ad1-46fb-b4a2-62e573eb2dcd] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:06.063245 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-2607f5a8-8d77-43e1-b6d6-bb3ab343d116 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:06.063799 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-2607f5a8-8d77-43e1-b6d6-bb3ab343d116 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:06.064655 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-2607f5a8-8d77-43e1-b6d6-bb3ab343d116 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:06.065193 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-2607f5a8-8d77-43e1-b6d6-bb3ab343d116 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:06.096202 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-2607f5a8-8d77-43e1-b6d6-bb3ab343d116 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:06.097337 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-2607f5a8-8d77-43e1-b6d6-bb3ab343d116 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:06.097850 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.objects.instance [None req-2607f5a8-8d77-43e1-b6d6-bb3ab343d116 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lazy-loading 'fault' on Instance uuid 10269bb5-0ad1-46fb-b4a2-62e573eb2dcd {{(pid=116071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 14 03:19:06.141707 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-2607f5a8-8d77-43e1-b6d6-bb3ab343d116 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:06.152392 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-2607f5a8-8d77-43e1-b6d6-bb3ab343d116 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/10269bb5-0ad1-46fb-b4a2-62e573eb2dcd" status: 200 len: 1307 microversion: 2.1 time: 0.099566 Dec 14 03:19:06.153841 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 309/644] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:19:06 2021] GET /compute/v2.1/servers/10269bb5-0ad1-46fb-b4a2-62e573eb2dcd => generated 1307 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:19:06.166545 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-14d56226-f514-45e5-844b-7f47ea1bf77c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:06.167858 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-14d56226-f514-45e5-844b-7f47ea1bf77c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:06.176913 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-14d56226-f514-45e5-844b-7f47ea1bf77c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:06.177455 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-14d56226-f514-45e5-844b-7f47ea1bf77c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:06.178568 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-14d56226-f514-45e5-844b-7f47ea1bf77c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:06.179193 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-14d56226-f514-45e5-844b-7f47ea1bf77c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:06.321065 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-14d56226-f514-45e5-844b-7f47ea1bf77c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:06.329431 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-14d56226-f514-45e5-844b-7f47ea1bf77c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:06.331827 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-14d56226-f514-45e5-844b-7f47ea1bf77c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:06.333218 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-14d56226-f514-45e5-844b-7f47ea1bf77c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1739 microversion: 2.20 time: 0.171137 Dec 14 03:19:06.344869 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 336/645] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:19:06 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1739 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:19:07.170505 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-49e9b966-1a90-40c1-bec1-865d65f57f13 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:07.171355 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-49e9b966-1a90-40c1-bec1-865d65f57f13 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: 10269bb5-0ad1-46fb-b4a2-62e573eb2dcd] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:07.178234 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-49e9b966-1a90-40c1-bec1-865d65f57f13 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:07.178686 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-49e9b966-1a90-40c1-bec1-865d65f57f13 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:07.179489 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-49e9b966-1a90-40c1-bec1-865d65f57f13 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:07.180121 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-49e9b966-1a90-40c1-bec1-865d65f57f13 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:07.195364 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.wsgi [None req-49e9b966-1a90-40c1-bec1-865d65f57f13 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] HTTP exception thrown: Instance 10269bb5-0ad1-46fb-b4a2-62e573eb2dcd could not be found. Dec 14 03:19:07.196202 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-49e9b966-1a90-40c1-bec1-865d65f57f13 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Returning 404 to user: Instance 10269bb5-0ad1-46fb-b4a2-62e573eb2dcd could not be found. {{(pid=116071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 03:19:07.197218 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-49e9b966-1a90-40c1-bec1-865d65f57f13 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/10269bb5-0ad1-46fb-b4a2-62e573eb2dcd" status: 404 len: 111 microversion: 2.1 time: 0.030286 Dec 14 03:19:07.197760 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 310/646] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:19:07 2021] GET /compute/v2.1/servers/10269bb5-0ad1-46fb-b4a2-62e573eb2dcd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 14 03:19:07.352350 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-3e666cc6-667d-4798-9eb4-f07baec03f5c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:07.352966 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-3e666cc6-667d-4798-9eb4-f07baec03f5c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:07.359443 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3e666cc6-667d-4798-9eb4-f07baec03f5c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:07.359891 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3e666cc6-667d-4798-9eb4-f07baec03f5c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:07.360865 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3e666cc6-667d-4798-9eb4-f07baec03f5c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:07.361308 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3e666cc6-667d-4798-9eb4-f07baec03f5c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:07.510183 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-3e666cc6-667d-4798-9eb4-f07baec03f5c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:07.518487 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-3e666cc6-667d-4798-9eb4-f07baec03f5c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:07.520344 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-3e666cc6-667d-4798-9eb4-f07baec03f5c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:07.521509 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-3e666cc6-667d-4798-9eb4-f07baec03f5c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1739 microversion: 2.20 time: 0.172900 Dec 14 03:19:07.533141 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 337/647] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:19:07 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1739 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:19:08.540449 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-aa7c2f10-eaab-499e-a312-da3f833cb666 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:08.541077 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-aa7c2f10-eaab-499e-a312-da3f833cb666 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:08.548684 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-aa7c2f10-eaab-499e-a312-da3f833cb666 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:08.548948 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-aa7c2f10-eaab-499e-a312-da3f833cb666 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:08.550245 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-aa7c2f10-eaab-499e-a312-da3f833cb666 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:08.551179 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-aa7c2f10-eaab-499e-a312-da3f833cb666 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:08.702535 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-aa7c2f10-eaab-499e-a312-da3f833cb666 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:08.710837 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-aa7c2f10-eaab-499e-a312-da3f833cb666 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:08.712676 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-aa7c2f10-eaab-499e-a312-da3f833cb666 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:08.714039 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-aa7c2f10-eaab-499e-a312-da3f833cb666 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1739 microversion: 2.20 time: 0.177612 Dec 14 03:19:08.715090 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 311/648] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:19:08 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1739 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:19:09.732475 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-0b69a1d8-f50c-4c83-8fbe-5cf4c5396ca1 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:09.733055 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-0b69a1d8-f50c-4c83-8fbe-5cf4c5396ca1 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:09.739537 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0b69a1d8-f50c-4c83-8fbe-5cf4c5396ca1 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:09.739986 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0b69a1d8-f50c-4c83-8fbe-5cf4c5396ca1 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:09.740754 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0b69a1d8-f50c-4c83-8fbe-5cf4c5396ca1 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:09.741188 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0b69a1d8-f50c-4c83-8fbe-5cf4c5396ca1 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:09.868808 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-0b69a1d8-f50c-4c83-8fbe-5cf4c5396ca1 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:09.876415 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-0b69a1d8-f50c-4c83-8fbe-5cf4c5396ca1 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:09.878400 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-0b69a1d8-f50c-4c83-8fbe-5cf4c5396ca1 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:09.879591 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-0b69a1d8-f50c-4c83-8fbe-5cf4c5396ca1 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1739 microversion: 2.20 time: 0.151038 Dec 14 03:19:09.880144 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 338/649] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:19:09 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1739 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:19:10.898229 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-3cba7e68-b090-4979-8f2a-3c147eea2f76 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:10.898987 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-3cba7e68-b090-4979-8f2a-3c147eea2f76 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:10.905833 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-3cba7e68-b090-4979-8f2a-3c147eea2f76 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:10.906289 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-3cba7e68-b090-4979-8f2a-3c147eea2f76 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:10.907100 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-3cba7e68-b090-4979-8f2a-3c147eea2f76 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:10.907542 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-3cba7e68-b090-4979-8f2a-3c147eea2f76 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:11.034979 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-3cba7e68-b090-4979-8f2a-3c147eea2f76 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:11.042612 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-3cba7e68-b090-4979-8f2a-3c147eea2f76 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:11.044186 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-3cba7e68-b090-4979-8f2a-3c147eea2f76 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:11.045338 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-3cba7e68-b090-4979-8f2a-3c147eea2f76 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1739 microversion: 2.20 time: 0.150860 Dec 14 03:19:11.045892 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 312/650] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:19:10 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1739 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:19:11.503747 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-4c641f87-4df8-44ee-836f-efde5b616bfc tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:11.503747 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-4c641f87-4df8-44ee-836f-efde5b616bfc tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: 095d132d-1529-4a41-a033-a8b41a1af328] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:11.508469 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4c641f87-4df8-44ee-836f-efde5b616bfc tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:11.508923 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4c641f87-4df8-44ee-836f-efde5b616bfc tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:11.509704 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4c641f87-4df8-44ee-836f-efde5b616bfc tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:11.510140 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4c641f87-4df8-44ee-836f-efde5b616bfc tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:11.534116 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-4c641f87-4df8-44ee-836f-efde5b616bfc tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: 095d132d-1529-4a41-a033-a8b41a1af328] Going to try to terminate instance {{(pid=116072) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 14 03:19:11.623184 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-4c641f87-4df8-44ee-836f-efde5b616bfc tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "DELETE /compute/v2.1/servers/095d132d-1529-4a41-a033-a8b41a1af328" status: 204 len: 0 microversion: 2.1 time: 0.125424 Dec 14 03:19:11.623770 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 339/651] 10.222.0.43 () {58 vars in 1238 bytes} [Tue Dec 14 03:19:11 2021] DELETE /compute/v2.1/servers/095d132d-1529-4a41-a033-a8b41a1af328 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 14 03:19:11.636161 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-b4557183-680e-46c5-b685-d20ad9a28cb0 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:11.636883 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-b4557183-680e-46c5-b685-d20ad9a28cb0 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: 095d132d-1529-4a41-a033-a8b41a1af328] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:11.643147 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b4557183-680e-46c5-b685-d20ad9a28cb0 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:11.643722 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b4557183-680e-46c5-b685-d20ad9a28cb0 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:11.644525 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b4557183-680e-46c5-b685-d20ad9a28cb0 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:11.644970 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b4557183-680e-46c5-b685-d20ad9a28cb0 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:11.781175 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-b4557183-680e-46c5-b685-d20ad9a28cb0 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:11.791242 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-b4557183-680e-46c5-b685-d20ad9a28cb0 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/095d132d-1529-4a41-a033-a8b41a1af328" status: 200 len: 1515 microversion: 2.1 time: 0.163384 Dec 14 03:19:11.791814 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 313/652] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:19:11 2021] GET /compute/v2.1/servers/095d132d-1529-4a41-a033-a8b41a1af328 => generated 1515 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:19:12.063836 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-44ee8283-4085-41c4-a781-66c02314d206 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:12.064651 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-44ee8283-4085-41c4-a781-66c02314d206 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:12.070976 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-44ee8283-4085-41c4-a781-66c02314d206 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:12.071463 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-44ee8283-4085-41c4-a781-66c02314d206 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:12.072238 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-44ee8283-4085-41c4-a781-66c02314d206 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:12.072673 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-44ee8283-4085-41c4-a781-66c02314d206 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:12.290465 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-44ee8283-4085-41c4-a781-66c02314d206 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:12.298256 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-44ee8283-4085-41c4-a781-66c02314d206 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:12.299838 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-44ee8283-4085-41c4-a781-66c02314d206 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:12.300981 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-44ee8283-4085-41c4-a781-66c02314d206 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1721 microversion: 2.20 time: 0.241250 Dec 14 03:19:12.301532 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 340/653] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:19:12 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1721 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:19:12.808198 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-24a7a17b-c1f7-45f9-a4e1-2f05777fa5cc tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:12.808855 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-24a7a17b-c1f7-45f9-a4e1-2f05777fa5cc tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: 095d132d-1529-4a41-a033-a8b41a1af328] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:12.815395 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-24a7a17b-c1f7-45f9-a4e1-2f05777fa5cc tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:12.815841 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-24a7a17b-c1f7-45f9-a4e1-2f05777fa5cc tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:12.816612 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-24a7a17b-c1f7-45f9-a4e1-2f05777fa5cc tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:12.817046 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-24a7a17b-c1f7-45f9-a4e1-2f05777fa5cc tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:12.946441 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-24a7a17b-c1f7-45f9-a4e1-2f05777fa5cc tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:12.953645 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-24a7a17b-c1f7-45f9-a4e1-2f05777fa5cc tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/095d132d-1529-4a41-a033-a8b41a1af328" status: 200 len: 1515 microversion: 2.1 time: 0.149153 Dec 14 03:19:12.954197 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 314/654] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:19:12 2021] GET /compute/v2.1/servers/095d132d-1529-4a41-a033-a8b41a1af328 => generated 1515 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:19:13.318546 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-4feb43b7-d7a4-4b41-a73a-3a1981717cca tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:13.319191 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-4feb43b7-d7a4-4b41-a73a-3a1981717cca tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:13.325422 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4feb43b7-d7a4-4b41-a73a-3a1981717cca tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:13.325877 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4feb43b7-d7a4-4b41-a73a-3a1981717cca tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:13.326651 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4feb43b7-d7a4-4b41-a73a-3a1981717cca tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:13.327116 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4feb43b7-d7a4-4b41-a73a-3a1981717cca tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:13.455021 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-4feb43b7-d7a4-4b41-a73a-3a1981717cca tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:13.463402 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-4feb43b7-d7a4-4b41-a73a-3a1981717cca tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:13.465011 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-4feb43b7-d7a4-4b41-a73a-3a1981717cca tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:13.466164 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-4feb43b7-d7a4-4b41-a73a-3a1981717cca tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1721 microversion: 2.20 time: 0.151307 Dec 14 03:19:13.466773 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 341/655] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:19:13 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:19:13.970878 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-d98dc466-6247-4a5c-b2d0-77fb900eb857 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:13.971445 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-d98dc466-6247-4a5c-b2d0-77fb900eb857 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: 095d132d-1529-4a41-a033-a8b41a1af328] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:13.978121 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-d98dc466-6247-4a5c-b2d0-77fb900eb857 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:13.978565 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-d98dc466-6247-4a5c-b2d0-77fb900eb857 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:13.979361 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-d98dc466-6247-4a5c-b2d0-77fb900eb857 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:13.979794 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-d98dc466-6247-4a5c-b2d0-77fb900eb857 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:14.108302 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-d98dc466-6247-4a5c-b2d0-77fb900eb857 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:14.115653 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-d98dc466-6247-4a5c-b2d0-77fb900eb857 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/095d132d-1529-4a41-a033-a8b41a1af328" status: 200 len: 1515 microversion: 2.1 time: 0.148506 Dec 14 03:19:14.116201 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 315/656] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:19:13 2021] GET /compute/v2.1/servers/095d132d-1529-4a41-a033-a8b41a1af328 => generated 1515 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:19:14.485441 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-dc81dba1-6d33-463c-9861-dfcbc4bf0765 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:14.486172 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-dc81dba1-6d33-463c-9861-dfcbc4bf0765 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:14.493298 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-dc81dba1-6d33-463c-9861-dfcbc4bf0765 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:14.493750 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-dc81dba1-6d33-463c-9861-dfcbc4bf0765 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:14.494522 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-dc81dba1-6d33-463c-9861-dfcbc4bf0765 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:14.494958 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-dc81dba1-6d33-463c-9861-dfcbc4bf0765 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:14.620681 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-dc81dba1-6d33-463c-9861-dfcbc4bf0765 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:14.628791 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-dc81dba1-6d33-463c-9861-dfcbc4bf0765 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:14.630281 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-dc81dba1-6d33-463c-9861-dfcbc4bf0765 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:14.631447 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-dc81dba1-6d33-463c-9861-dfcbc4bf0765 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1721 microversion: 2.20 time: 0.149606 Dec 14 03:19:14.632005 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 342/657] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:19:14 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:19:15.131430 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-f0c2c9a5-0d6c-4ce9-ba25-5ec4ad8b61c7 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:15.132037 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-f0c2c9a5-0d6c-4ce9-ba25-5ec4ad8b61c7 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: 095d132d-1529-4a41-a033-a8b41a1af328] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:15.138138 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-f0c2c9a5-0d6c-4ce9-ba25-5ec4ad8b61c7 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:15.138589 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-f0c2c9a5-0d6c-4ce9-ba25-5ec4ad8b61c7 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:15.139381 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-f0c2c9a5-0d6c-4ce9-ba25-5ec4ad8b61c7 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:15.139813 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-f0c2c9a5-0d6c-4ce9-ba25-5ec4ad8b61c7 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:15.266052 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-f0c2c9a5-0d6c-4ce9-ba25-5ec4ad8b61c7 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:15.273638 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-f0c2c9a5-0d6c-4ce9-ba25-5ec4ad8b61c7 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/095d132d-1529-4a41-a033-a8b41a1af328" status: 200 len: 1515 microversion: 2.1 time: 0.145836 Dec 14 03:19:15.274188 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 316/658] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:19:15 2021] GET /compute/v2.1/servers/095d132d-1529-4a41-a033-a8b41a1af328 => generated 1515 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:19:15.649410 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-c7d4b112-c34f-4d9b-a1c1-bfe2a8398d3d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:15.650005 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-c7d4b112-c34f-4d9b-a1c1-bfe2a8398d3d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:15.656357 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c7d4b112-c34f-4d9b-a1c1-bfe2a8398d3d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:15.656795 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c7d4b112-c34f-4d9b-a1c1-bfe2a8398d3d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:15.657563 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c7d4b112-c34f-4d9b-a1c1-bfe2a8398d3d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:15.657993 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c7d4b112-c34f-4d9b-a1c1-bfe2a8398d3d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:15.798016 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-c7d4b112-c34f-4d9b-a1c1-bfe2a8398d3d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:15.806162 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-c7d4b112-c34f-4d9b-a1c1-bfe2a8398d3d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:15.807659 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-c7d4b112-c34f-4d9b-a1c1-bfe2a8398d3d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:15.808827 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-c7d4b112-c34f-4d9b-a1c1-bfe2a8398d3d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1721 microversion: 2.20 time: 0.163006 Dec 14 03:19:15.809375 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 343/659] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:19:15 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:19:16.290062 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-051e4d99-b6f5-4b04-b842-40703186f8b2 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:16.290759 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-051e4d99-b6f5-4b04-b842-40703186f8b2 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: 095d132d-1529-4a41-a033-a8b41a1af328] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:16.297594 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-051e4d99-b6f5-4b04-b842-40703186f8b2 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:16.298055 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-051e4d99-b6f5-4b04-b842-40703186f8b2 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:16.298864 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-051e4d99-b6f5-4b04-b842-40703186f8b2 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:16.299349 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-051e4d99-b6f5-4b04-b842-40703186f8b2 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:16.394636 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [req-cb568efc-7047-4bab-a552-3bda4202da92 req-35c65af5-7b1b-46e6-95b4-f295dac756fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86395107-d320-45d8-83de-f1848858be10", "name": "network-vif-unplugged", "status": "completed", "tag": "85ceb16f-0c27-48e9-ab76-5cd49eb12802"}]} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:19:16.396467 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:19:16.396467 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: warnings.warn(msg) Dec 14 03:19:16.404143 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-cb568efc-7047-4bab-a552-3bda4202da92 req-35c65af5-7b1b-46e6-95b4-f295dac756fe service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:16.404828 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-cb568efc-7047-4bab-a552-3bda4202da92 req-35c65af5-7b1b-46e6-95b4-f295dac756fe service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:16.416343 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.compute.server_external_events [req-cb568efc-7047-4bab-a552-3bda4202da92 req-35c65af5-7b1b-46e6-95b4-f295dac756fe service nova] Creating event network-vif-unplugged:85ceb16f-0c27-48e9-ab76-5cd49eb12802 for instance 86395107-d320-45d8-83de-f1848858be10 on hv-cinder-81803 Dec 14 03:19:16.422400 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [req-cb568efc-7047-4bab-a552-3bda4202da92 req-35c65af5-7b1b-46e6-95b4-f295dac756fe service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032071 Dec 14 03:19:16.423330 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 344/660] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Dec 14 03:19:16 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:19:16.549409 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-051e4d99-b6f5-4b04-b842-40703186f8b2 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:16.557052 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-051e4d99-b6f5-4b04-b842-40703186f8b2 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/095d132d-1529-4a41-a033-a8b41a1af328" status: 200 len: 1515 microversion: 2.1 time: 0.270679 Dec 14 03:19:16.557611 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 317/661] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:19:16 2021] GET /compute/v2.1/servers/095d132d-1529-4a41-a033-a8b41a1af328 => generated 1515 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:19:16.827556 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-59ac6f3b-3b4e-4775-883e-cd4b5e56fc2d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:16.828284 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-59ac6f3b-3b4e-4775-883e-cd4b5e56fc2d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:16.834750 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-59ac6f3b-3b4e-4775-883e-cd4b5e56fc2d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:16.835240 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-59ac6f3b-3b4e-4775-883e-cd4b5e56fc2d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:16.836020 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-59ac6f3b-3b4e-4775-883e-cd4b5e56fc2d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:16.836454 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-59ac6f3b-3b4e-4775-883e-cd4b5e56fc2d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:16.963356 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-59ac6f3b-3b4e-4775-883e-cd4b5e56fc2d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:16.971003 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-59ac6f3b-3b4e-4775-883e-cd4b5e56fc2d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:16.972525 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-59ac6f3b-3b4e-4775-883e-cd4b5e56fc2d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:16.973673 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-59ac6f3b-3b4e-4775-883e-cd4b5e56fc2d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1721 microversion: 2.20 time: 0.150099 Dec 14 03:19:16.974232 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 345/662] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:19:16 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:19:17.573329 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-fe1d1e3e-2046-445c-886a-5a7998f1efc7 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:17.573985 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-fe1d1e3e-2046-445c-886a-5a7998f1efc7 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: 095d132d-1529-4a41-a033-a8b41a1af328] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:17.580591 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-fe1d1e3e-2046-445c-886a-5a7998f1efc7 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:17.581041 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-fe1d1e3e-2046-445c-886a-5a7998f1efc7 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:17.581936 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-fe1d1e3e-2046-445c-886a-5a7998f1efc7 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:17.582380 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-fe1d1e3e-2046-445c-886a-5a7998f1efc7 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:17.714750 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-fe1d1e3e-2046-445c-886a-5a7998f1efc7 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:17.722160 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-fe1d1e3e-2046-445c-886a-5a7998f1efc7 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/095d132d-1529-4a41-a033-a8b41a1af328" status: 200 len: 1515 microversion: 2.1 time: 0.152457 Dec 14 03:19:17.722723 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 318/663] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:19:17 2021] GET /compute/v2.1/servers/095d132d-1529-4a41-a033-a8b41a1af328 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:19:17.999640 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-b4111aec-4c64-4212-a521-f05d49efdfe0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:18.000254 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-b4111aec-4c64-4212-a521-f05d49efdfe0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:18.013837 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b4111aec-4c64-4212-a521-f05d49efdfe0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:18.017466 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b4111aec-4c64-4212-a521-f05d49efdfe0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:18.017466 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b4111aec-4c64-4212-a521-f05d49efdfe0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:18.017466 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b4111aec-4c64-4212-a521-f05d49efdfe0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:18.218167 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-b4111aec-4c64-4212-a521-f05d49efdfe0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:18.226494 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-b4111aec-4c64-4212-a521-f05d49efdfe0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:18.228001 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-b4111aec-4c64-4212-a521-f05d49efdfe0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:18.229144 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-b4111aec-4c64-4212-a521-f05d49efdfe0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1721 microversion: 2.20 time: 0.236207 Dec 14 03:19:18.229692 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 346/664] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:19:17 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1721 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:19:18.522180 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [req-9721fc7e-4581-460f-8c38-166a26cc4e98 req-2d40daab-c1b8-4bb9-9c0c-5f6037227be2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "095d132d-1529-4a41-a033-a8b41a1af328", "name": "network-vif-deleted", "tag": "fa30f5e8-3d02-4477-a5a9-b31ae00e7c7b"}]} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:19:18.523802 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:19:18.523802 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: warnings.warn(msg) Dec 14 03:19:18.533262 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [req-9721fc7e-4581-460f-8c38-166a26cc4e98 req-2d40daab-c1b8-4bb9-9c0c-5f6037227be2 service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:18.534526 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [req-9721fc7e-4581-460f-8c38-166a26cc4e98 req-2d40daab-c1b8-4bb9-9c0c-5f6037227be2 service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:18.546026 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.compute.server_external_events [req-9721fc7e-4581-460f-8c38-166a26cc4e98 req-2d40daab-c1b8-4bb9-9c0c-5f6037227be2 service nova] Creating event network-vif-deleted:fa30f5e8-3d02-4477-a5a9-b31ae00e7c7b for instance 095d132d-1529-4a41-a033-a8b41a1af328 on hv-cinder-81803 Dec 14 03:19:18.553036 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [req-9721fc7e-4581-460f-8c38-166a26cc4e98 req-2d40daab-c1b8-4bb9-9c0c-5f6037227be2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035383 Dec 14 03:19:18.553809 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 319/665] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Dec 14 03:19:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:19:18.739194 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-a9a7c666-06d2-4523-8406-8bb56cee4b1f tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:18.739801 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-a9a7c666-06d2-4523-8406-8bb56cee4b1f tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: 095d132d-1529-4a41-a033-a8b41a1af328] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:18.745726 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a9a7c666-06d2-4523-8406-8bb56cee4b1f tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:18.746181 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a9a7c666-06d2-4523-8406-8bb56cee4b1f tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:18.746950 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a9a7c666-06d2-4523-8406-8bb56cee4b1f tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:18.747415 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a9a7c666-06d2-4523-8406-8bb56cee4b1f tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:18.776106 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a9a7c666-06d2-4523-8406-8bb56cee4b1f tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:18.776550 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a9a7c666-06d2-4523-8406-8bb56cee4b1f tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:18.776992 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.objects.instance [None req-a9a7c666-06d2-4523-8406-8bb56cee4b1f tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lazy-loading 'fault' on Instance uuid 095d132d-1529-4a41-a033-a8b41a1af328 {{(pid=116072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 14 03:19:18.814992 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-a9a7c666-06d2-4523-8406-8bb56cee4b1f tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:18.822087 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-a9a7c666-06d2-4523-8406-8bb56cee4b1f tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/095d132d-1529-4a41-a033-a8b41a1af328" status: 200 len: 1308 microversion: 2.1 time: 0.087430 Dec 14 03:19:18.822646 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 347/666] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:19:18 2021] GET /compute/v2.1/servers/095d132d-1529-4a41-a033-a8b41a1af328 => generated 1308 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:19:19.249228 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-89db5595-457e-4ac5-bfd2-8239aa2dd031 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:19.250194 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-89db5595-457e-4ac5-bfd2-8239aa2dd031 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:19.257200 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-89db5595-457e-4ac5-bfd2-8239aa2dd031 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:19.257648 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-89db5595-457e-4ac5-bfd2-8239aa2dd031 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:19.258465 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-89db5595-457e-4ac5-bfd2-8239aa2dd031 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:19.258897 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-89db5595-457e-4ac5-bfd2-8239aa2dd031 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:19.402831 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-89db5595-457e-4ac5-bfd2-8239aa2dd031 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:19.411791 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-89db5595-457e-4ac5-bfd2-8239aa2dd031 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:19.413478 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-89db5595-457e-4ac5-bfd2-8239aa2dd031 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:19.414639 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-89db5595-457e-4ac5-bfd2-8239aa2dd031 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1724 microversion: 2.20 time: 0.169773 Dec 14 03:19:19.415221 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 320/667] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:19:19 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:19:19.433279 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-56494214-ac2c-4ee5-972c-8689fe2055b9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "25c4a8a1-e445-4c3d-88d2-bf2e05777b27"}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:19:19.434476 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-56494214-ac2c-4ee5-972c-8689fe2055b9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:19.441561 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-56494214-ac2c-4ee5-972c-8689fe2055b9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:19.442241 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-56494214-ac2c-4ee5-972c-8689fe2055b9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:19.443114 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-56494214-ac2c-4ee5-972c-8689fe2055b9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:19.443609 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-56494214-ac2c-4ee5-972c-8689fe2055b9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:19.724904 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-56494214-ac2c-4ee5-972c-8689fe2055b9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.295598 Dec 14 03:19:19.725478 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 348/668] 10.222.0.43 () {62 vars in 1363 bytes} [Tue Dec 14 03:19:19 2021] POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/os-volume_attachments => generated 188 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:19:19.831998 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-b2ae42aa-1886-4cf3-adf1-c02c65995f8e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:19:19.832598 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-b2ae42aa-1886-4cf3-adf1-c02c65995f8e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:19.838582 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b2ae42aa-1886-4cf3-adf1-c02c65995f8e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:19.838739 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-94a97cc8-7a73-4f83-ade1-2c9570bbc979 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:19.839028 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b2ae42aa-1886-4cf3-adf1-c02c65995f8e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:19.839369 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-94a97cc8-7a73-4f83-ade1-2c9570bbc979 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: 095d132d-1529-4a41-a033-a8b41a1af328] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:19.839830 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b2ae42aa-1886-4cf3-adf1-c02c65995f8e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:19.840264 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b2ae42aa-1886-4cf3-adf1-c02c65995f8e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:19.845769 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-94a97cc8-7a73-4f83-ade1-2c9570bbc979 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:19.846223 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-94a97cc8-7a73-4f83-ade1-2c9570bbc979 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:19.847007 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-94a97cc8-7a73-4f83-ade1-2c9570bbc979 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:19.847479 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-94a97cc8-7a73-4f83-ade1-2c9570bbc979 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:19.860166 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.wsgi [None req-94a97cc8-7a73-4f83-ade1-2c9570bbc979 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] HTTP exception thrown: Instance 095d132d-1529-4a41-a033-a8b41a1af328 could not be found. Dec 14 03:19:19.860758 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-94a97cc8-7a73-4f83-ade1-2c9570bbc979 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Returning 404 to user: Instance 095d132d-1529-4a41-a033-a8b41a1af328 could not be found. {{(pid=116072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 03:19:19.861578 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-94a97cc8-7a73-4f83-ade1-2c9570bbc979 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/095d132d-1529-4a41-a033-a8b41a1af328" status: 404 len: 111 microversion: 2.1 time: 0.026642 Dec 14 03:19:19.862628 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 349/669] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:19:19 2021] GET /compute/v2.1/servers/095d132d-1529-4a41-a033-a8b41a1af328 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 14 03:19:19.870101 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-3d46fe16-3d7d-4624-8b08-ceed929eb159 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:19.870675 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-3d46fe16-3d7d-4624-8b08-ceed929eb159 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:19.876634 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3d46fe16-3d7d-4624-8b08-ceed929eb159 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:19.877163 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3d46fe16-3d7d-4624-8b08-ceed929eb159 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:19.878762 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3d46fe16-3d7d-4624-8b08-ceed929eb159 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:19.879243 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3d46fe16-3d7d-4624-8b08-ceed929eb159 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:19.902849 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-3d46fe16-3d7d-4624-8b08-ceed929eb159 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe] Going to try to terminate instance {{(pid=116072) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 14 03:19:19.929468 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-b2ae42aa-1886-4cf3-adf1-c02c65995f8e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action" status: 202 len: 0 microversion: 2.20 time: 0.101018 Dec 14 03:19:19.932719 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 321/670] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:19:19 2021] POST /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 14 03:19:19.937307 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-88f3e210-fc32-4022-ba6b-b146f97d000e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:19.938145 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-88f3e210-fc32-4022-ba6b-b146f97d000e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:19.945426 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-88f3e210-fc32-4022-ba6b-b146f97d000e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:19.945890 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-88f3e210-fc32-4022-ba6b-b146f97d000e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:19.946680 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-88f3e210-fc32-4022-ba6b-b146f97d000e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:19.947171 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-88f3e210-fc32-4022-ba6b-b146f97d000e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:19.981535 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-3d46fe16-3d7d-4624-8b08-ceed929eb159 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "DELETE /compute/v2.1/servers/e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe" status: 204 len: 0 microversion: 2.1 time: 0.114270 Dec 14 03:19:19.982229 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 350/671] 10.222.0.43 () {58 vars in 1238 bytes} [Tue Dec 14 03:19:19 2021] DELETE /compute/v2.1/servers/e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 14 03:19:19.991757 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-60b1c1d3-8b5f-455c-8b8b-662b06389116 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:19.992583 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-60b1c1d3-8b5f-455c-8b8b-662b06389116 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:19.999514 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-60b1c1d3-8b5f-455c-8b8b-662b06389116 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:20.000091 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-60b1c1d3-8b5f-455c-8b8b-662b06389116 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:20.000982 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-60b1c1d3-8b5f-455c-8b8b-662b06389116 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:20.001527 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-60b1c1d3-8b5f-455c-8b8b-662b06389116 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:20.120676 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-88f3e210-fc32-4022-ba6b-b146f97d000e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:20.131618 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-88f3e210-fc32-4022-ba6b-b146f97d000e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:20.133329 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-88f3e210-fc32-4022-ba6b-b146f97d000e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:20.135116 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-88f3e210-fc32-4022-ba6b-b146f97d000e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1750 microversion: 2.20 time: 0.200989 Dec 14 03:19:20.135818 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 322/672] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:19:19 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1750 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 14 03:19:20.168255 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-60b1c1d3-8b5f-455c-8b8b-662b06389116 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:20.176113 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-60b1c1d3-8b5f-455c-8b8b-662b06389116 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe" status: 200 len: 1513 microversion: 2.1 time: 0.189538 Dec 14 03:19:20.176757 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 351/673] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:19:19 2021] GET /compute/v2.1/servers/e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe => generated 1513 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 03:19:21.152630 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-61c437f8-4682-4136-b8b8-663a4ad0d80a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:21.153266 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-61c437f8-4682-4136-b8b8-663a4ad0d80a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:21.159556 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-61c437f8-4682-4136-b8b8-663a4ad0d80a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:21.160010 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-61c437f8-4682-4136-b8b8-663a4ad0d80a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:21.160789 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-61c437f8-4682-4136-b8b8-663a4ad0d80a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:21.161229 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-61c437f8-4682-4136-b8b8-663a4ad0d80a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:21.193881 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-e553caf1-6621-4911-ab62-1695d28bf446 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:21.194605 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-e553caf1-6621-4911-ab62-1695d28bf446 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:21.200610 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e553caf1-6621-4911-ab62-1695d28bf446 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:21.201059 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e553caf1-6621-4911-ab62-1695d28bf446 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:21.201839 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e553caf1-6621-4911-ab62-1695d28bf446 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:21.202269 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e553caf1-6621-4911-ab62-1695d28bf446 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:21.323469 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-61c437f8-4682-4136-b8b8-663a4ad0d80a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:21.331840 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-61c437f8-4682-4136-b8b8-663a4ad0d80a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:21.333446 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-61c437f8-4682-4136-b8b8-663a4ad0d80a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:21.334670 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-61c437f8-4682-4136-b8b8-663a4ad0d80a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1750 microversion: 2.20 time: 0.185736 Dec 14 03:19:21.335345 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 323/674] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:19:21 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1750 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:19:21.364811 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-e553caf1-6621-4911-ab62-1695d28bf446 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:21.371989 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-e553caf1-6621-4911-ab62-1695d28bf446 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe" status: 200 len: 1513 microversion: 2.1 time: 0.182250 Dec 14 03:19:21.372579 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 352/675] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:19:21 2021] GET /compute/v2.1/servers/e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe => generated 1513 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 03:19:22.352733 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-466c2729-f77c-49f9-b3b7-44599257abae tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:22.353347 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-466c2729-f77c-49f9-b3b7-44599257abae tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:22.359575 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-466c2729-f77c-49f9-b3b7-44599257abae tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:22.360033 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-466c2729-f77c-49f9-b3b7-44599257abae tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:22.360818 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-466c2729-f77c-49f9-b3b7-44599257abae tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:22.361260 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-466c2729-f77c-49f9-b3b7-44599257abae tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:22.389217 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-12bcdc26-8703-4cf0-88f1-264432b271d1 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:22.389832 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-12bcdc26-8703-4cf0-88f1-264432b271d1 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:22.396704 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-12bcdc26-8703-4cf0-88f1-264432b271d1 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:22.397161 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-12bcdc26-8703-4cf0-88f1-264432b271d1 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:22.397944 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-12bcdc26-8703-4cf0-88f1-264432b271d1 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:22.398503 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-12bcdc26-8703-4cf0-88f1-264432b271d1 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:22.524491 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-466c2729-f77c-49f9-b3b7-44599257abae tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:22.532685 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-466c2729-f77c-49f9-b3b7-44599257abae tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:22.534180 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-466c2729-f77c-49f9-b3b7-44599257abae tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:22.535347 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-466c2729-f77c-49f9-b3b7-44599257abae tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1750 microversion: 2.20 time: 0.186235 Dec 14 03:19:22.535905 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 324/676] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:19:22 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1750 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:19:22.567497 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-12bcdc26-8703-4cf0-88f1-264432b271d1 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:22.574760 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-12bcdc26-8703-4cf0-88f1-264432b271d1 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe" status: 200 len: 1513 microversion: 2.1 time: 0.189223 Dec 14 03:19:22.575352 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 353/677] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:19:22 2021] GET /compute/v2.1/servers/e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe => generated 1513 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 03:19:23.553752 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-49ff60c7-1601-4d3f-9995-84f2232239b0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:23.554350 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-49ff60c7-1601-4d3f-9995-84f2232239b0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:23.560522 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-49ff60c7-1601-4d3f-9995-84f2232239b0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:23.560969 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-49ff60c7-1601-4d3f-9995-84f2232239b0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:23.561738 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-49ff60c7-1601-4d3f-9995-84f2232239b0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:23.562173 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-49ff60c7-1601-4d3f-9995-84f2232239b0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:23.592512 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-36efa6d1-fe24-4f3d-89a2-5633a2928ca4 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:23.593135 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-36efa6d1-fe24-4f3d-89a2-5633a2928ca4 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:23.599500 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-36efa6d1-fe24-4f3d-89a2-5633a2928ca4 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:23.599975 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-36efa6d1-fe24-4f3d-89a2-5633a2928ca4 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:23.600760 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-36efa6d1-fe24-4f3d-89a2-5633a2928ca4 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:23.601196 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-36efa6d1-fe24-4f3d-89a2-5633a2928ca4 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:23.741805 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-49ff60c7-1601-4d3f-9995-84f2232239b0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:23.750230 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-49ff60c7-1601-4d3f-9995-84f2232239b0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:23.751752 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-49ff60c7-1601-4d3f-9995-84f2232239b0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:23.753549 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-49ff60c7-1601-4d3f-9995-84f2232239b0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1750 microversion: 2.20 time: 0.203965 Dec 14 03:19:23.754415 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 325/678] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:19:23 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1750 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:19:23.774040 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-36efa6d1-fe24-4f3d-89a2-5633a2928ca4 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:23.781365 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-36efa6d1-fe24-4f3d-89a2-5633a2928ca4 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe" status: 200 len: 1513 microversion: 2.1 time: 0.192954 Dec 14 03:19:23.781917 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 354/679] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:19:23 2021] GET /compute/v2.1/servers/e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe => generated 1513 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 03:19:24.771673 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-33dbfa2b-7086-415c-9e37-fabf50eb9b69 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:24.772303 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-33dbfa2b-7086-415c-9e37-fabf50eb9b69 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:24.778656 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-33dbfa2b-7086-415c-9e37-fabf50eb9b69 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:24.779135 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-33dbfa2b-7086-415c-9e37-fabf50eb9b69 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:24.779906 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-33dbfa2b-7086-415c-9e37-fabf50eb9b69 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:24.780340 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-33dbfa2b-7086-415c-9e37-fabf50eb9b69 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:24.797264 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-f3768292-cb41-4e37-bd87-4228a2230713 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:24.797883 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-f3768292-cb41-4e37-bd87-4228a2230713 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:24.805099 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f3768292-cb41-4e37-bd87-4228a2230713 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:24.805552 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f3768292-cb41-4e37-bd87-4228a2230713 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:24.806380 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f3768292-cb41-4e37-bd87-4228a2230713 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:24.806821 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f3768292-cb41-4e37-bd87-4228a2230713 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:24.981788 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-33dbfa2b-7086-415c-9e37-fabf50eb9b69 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:24.990297 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-33dbfa2b-7086-415c-9e37-fabf50eb9b69 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:24.991942 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-33dbfa2b-7086-415c-9e37-fabf50eb9b69 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:24.993083 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-33dbfa2b-7086-415c-9e37-fabf50eb9b69 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1750 microversion: 2.20 time: 0.225112 Dec 14 03:19:24.993638 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 326/680] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:19:24 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1750 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:19:24.996071 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-f3768292-cb41-4e37-bd87-4228a2230713 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:25.003512 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-f3768292-cb41-4e37-bd87-4228a2230713 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe" status: 200 len: 1513 microversion: 2.1 time: 0.209827 Dec 14 03:19:25.004248 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 355/681] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:19:24 2021] GET /compute/v2.1/servers/e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe => generated 1513 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 03:19:26.011312 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-909f866b-e9b5-4666-9302-3c13a46f7da6 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:26.011858 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-909f866b-e9b5-4666-9302-3c13a46f7da6 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:26.018483 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-909f866b-e9b5-4666-9302-3c13a46f7da6 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:26.018946 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-909f866b-e9b5-4666-9302-3c13a46f7da6 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:26.019806 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-909f866b-e9b5-4666-9302-3c13a46f7da6 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:26.020247 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-909f866b-e9b5-4666-9302-3c13a46f7da6 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:26.020407 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-7b1c2aba-93f1-4d7d-a494-390c31641f19 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:26.021029 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-7b1c2aba-93f1-4d7d-a494-390c31641f19 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:26.027168 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7b1c2aba-93f1-4d7d-a494-390c31641f19 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:26.027610 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7b1c2aba-93f1-4d7d-a494-390c31641f19 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:26.028374 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7b1c2aba-93f1-4d7d-a494-390c31641f19 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:26.028829 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7b1c2aba-93f1-4d7d-a494-390c31641f19 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:26.213819 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-909f866b-e9b5-4666-9302-3c13a46f7da6 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:26.216893 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-7b1c2aba-93f1-4d7d-a494-390c31641f19 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:26.223379 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-909f866b-e9b5-4666-9302-3c13a46f7da6 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:26.224878 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-909f866b-e9b5-4666-9302-3c13a46f7da6 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:26.225256 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-7b1c2aba-93f1-4d7d-a494-390c31641f19 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe" status: 200 len: 1513 microversion: 2.1 time: 0.208724 Dec 14 03:19:26.226024 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 356/682] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:19:26 2021] GET /compute/v2.1/servers/e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe => generated 1513 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 03:19:26.226536 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-909f866b-e9b5-4666-9302-3c13a46f7da6 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1752 microversion: 2.20 time: 0.219006 Dec 14 03:19:26.227111 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 327/683] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:19:26 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1752 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:19:27.244460 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-9eaa127f-2279-4dac-a8ad-97440124b403 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:27.245102 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-9eaa127f-2279-4dac-a8ad-97440124b403 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:27.246057 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-7e71c1be-f3cc-437b-bd4f-7b64f2bae589 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:27.247884 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-7e71c1be-f3cc-437b-bd4f-7b64f2bae589 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:27.251490 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9eaa127f-2279-4dac-a8ad-97440124b403 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:27.252005 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9eaa127f-2279-4dac-a8ad-97440124b403 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:27.253412 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9eaa127f-2279-4dac-a8ad-97440124b403 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:27.254265 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9eaa127f-2279-4dac-a8ad-97440124b403 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:27.254958 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-7e71c1be-f3cc-437b-bd4f-7b64f2bae589 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:27.255450 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-7e71c1be-f3cc-437b-bd4f-7b64f2bae589 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:27.256236 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-7e71c1be-f3cc-437b-bd4f-7b64f2bae589 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:27.256663 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-7e71c1be-f3cc-437b-bd4f-7b64f2bae589 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:27.550806 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-7e71c1be-f3cc-437b-bd4f-7b64f2bae589 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:27.555347 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-9eaa127f-2279-4dac-a8ad-97440124b403 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:27.561623 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-7e71c1be-f3cc-437b-bd4f-7b64f2bae589 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:27.563369 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-7e71c1be-f3cc-437b-bd4f-7b64f2bae589 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:27.564523 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-7e71c1be-f3cc-437b-bd4f-7b64f2bae589 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1808 microversion: 2.20 time: 0.322907 Dec 14 03:19:27.564978 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-9eaa127f-2279-4dac-a8ad-97440124b403 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe" status: 200 len: 1513 microversion: 2.1 time: 0.325732 Dec 14 03:19:27.565627 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 357/684] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:19:27 2021] GET /compute/v2.1/servers/e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe => generated 1513 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:19:27.574778 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 328/685] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:19:27 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1808 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 14 03:19:27.640225 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [req-55242e43-1439-47a0-92a2-15a06e2d9994 req-00646582-5300-4268-966e-d39fc5006bbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe", "name": "network-vif-deleted", "tag": "9ffbafb8-f71a-4067-8988-a284fbb41603"}]} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:19:27.641842 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:19:27.641842 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: warnings.warn(msg) Dec 14 03:19:27.648625 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-55242e43-1439-47a0-92a2-15a06e2d9994 req-00646582-5300-4268-966e-d39fc5006bbd service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:27.649042 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-55242e43-1439-47a0-92a2-15a06e2d9994 req-00646582-5300-4268-966e-d39fc5006bbd service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:27.660572 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.compute.server_external_events [req-55242e43-1439-47a0-92a2-15a06e2d9994 req-00646582-5300-4268-966e-d39fc5006bbd service nova] Creating event network-vif-deleted:9ffbafb8-f71a-4067-8988-a284fbb41603 for instance e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe on hv-cinder-81803 Dec 14 03:19:27.665356 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [req-55242e43-1439-47a0-92a2-15a06e2d9994 req-00646582-5300-4268-966e-d39fc5006bbd service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028781 Dec 14 03:19:27.665921 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 358/686] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Dec 14 03:19:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:19:28.581575 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-63be7675-9067-4622-8193-82a606454f9e tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:28.582293 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-63be7675-9067-4622-8193-82a606454f9e tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:28.583690 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-4b0013cb-cb4a-42f7-90df-a463e8805da2 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:28.584391 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-4b0013cb-cb4a-42f7-90df-a463e8805da2 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:28.588246 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-63be7675-9067-4622-8193-82a606454f9e tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:28.588694 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-63be7675-9067-4622-8193-82a606454f9e tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:28.589468 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-63be7675-9067-4622-8193-82a606454f9e tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:28.589901 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-63be7675-9067-4622-8193-82a606454f9e tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:28.590277 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4b0013cb-cb4a-42f7-90df-a463e8805da2 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:28.590728 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4b0013cb-cb4a-42f7-90df-a463e8805da2 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:28.591537 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4b0013cb-cb4a-42f7-90df-a463e8805da2 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:28.592001 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4b0013cb-cb4a-42f7-90df-a463e8805da2 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:28.655830 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-63be7675-9067-4622-8193-82a606454f9e tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:28.664098 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-63be7675-9067-4622-8193-82a606454f9e tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe" status: 200 len: 1471 microversion: 2.1 time: 0.086341 Dec 14 03:19:28.664667 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 329/687] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:19:28 2021] GET /compute/v2.1/servers/e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe => generated 1471 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:19:28.737623 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-4b0013cb-cb4a-42f7-90df-a463e8805da2 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:28.745959 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-4b0013cb-cb4a-42f7-90df-a463e8805da2 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:28.747493 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-4b0013cb-cb4a-42f7-90df-a463e8805da2 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:28.748651 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-4b0013cb-cb4a-42f7-90df-a463e8805da2 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1808 microversion: 2.20 time: 0.169443 Dec 14 03:19:28.749183 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 359/688] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:19:28 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 14 03:19:29.680544 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-2385b5be-2e41-4f7c-ba81-b0514087e14b tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:29.681162 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-2385b5be-2e41-4f7c-ba81-b0514087e14b tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:29.687410 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-2385b5be-2e41-4f7c-ba81-b0514087e14b tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:29.687864 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-2385b5be-2e41-4f7c-ba81-b0514087e14b tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:29.688644 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-2385b5be-2e41-4f7c-ba81-b0514087e14b tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:29.689080 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-2385b5be-2e41-4f7c-ba81-b0514087e14b tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:29.748557 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-2385b5be-2e41-4f7c-ba81-b0514087e14b tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:29.756320 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-2385b5be-2e41-4f7c-ba81-b0514087e14b tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe" status: 200 len: 1471 microversion: 2.1 time: 0.079388 Dec 14 03:19:29.756873 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 330/689] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:19:29 2021] GET /compute/v2.1/servers/e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe => generated 1471 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:19:29.766501 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-34ee05a5-514b-4a54-82a9-9847b9085316 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:29.767133 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-34ee05a5-514b-4a54-82a9-9847b9085316 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:29.773409 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-34ee05a5-514b-4a54-82a9-9847b9085316 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:29.773851 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-34ee05a5-514b-4a54-82a9-9847b9085316 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:29.774614 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-34ee05a5-514b-4a54-82a9-9847b9085316 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:29.775059 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-34ee05a5-514b-4a54-82a9-9847b9085316 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:29.903648 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-34ee05a5-514b-4a54-82a9-9847b9085316 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:29.912279 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-34ee05a5-514b-4a54-82a9-9847b9085316 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:29.913725 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-34ee05a5-514b-4a54-82a9-9847b9085316 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:29.914873 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-34ee05a5-514b-4a54-82a9-9847b9085316 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1808 microversion: 2.20 time: 0.152028 Dec 14 03:19:29.915475 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 360/690] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:19:29 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:19:30.772996 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-fd1e8e0b-4c21-4bfa-acfc-53a6a6383608 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:30.773535 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-fd1e8e0b-4c21-4bfa-acfc-53a6a6383608 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:30.779778 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-fd1e8e0b-4c21-4bfa-acfc-53a6a6383608 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:30.780241 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-fd1e8e0b-4c21-4bfa-acfc-53a6a6383608 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:30.781051 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-fd1e8e0b-4c21-4bfa-acfc-53a6a6383608 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:30.781494 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-fd1e8e0b-4c21-4bfa-acfc-53a6a6383608 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:30.839075 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-fd1e8e0b-4c21-4bfa-acfc-53a6a6383608 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:30.846464 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-fd1e8e0b-4c21-4bfa-acfc-53a6a6383608 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe" status: 200 len: 1471 microversion: 2.1 time: 0.077154 Dec 14 03:19:30.847024 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 331/691] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:19:30 2021] GET /compute/v2.1/servers/e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe => generated 1471 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:19:30.933474 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-271e970e-27bd-4f23-9fa8-011432d18543 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:30.934092 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-271e970e-27bd-4f23-9fa8-011432d18543 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:30.940909 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-271e970e-27bd-4f23-9fa8-011432d18543 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:30.941365 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-271e970e-27bd-4f23-9fa8-011432d18543 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:30.942196 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-271e970e-27bd-4f23-9fa8-011432d18543 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:30.942664 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-271e970e-27bd-4f23-9fa8-011432d18543 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:31.120606 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-271e970e-27bd-4f23-9fa8-011432d18543 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:31.129367 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-271e970e-27bd-4f23-9fa8-011432d18543 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:31.130859 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-271e970e-27bd-4f23-9fa8-011432d18543 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:31.132042 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-271e970e-27bd-4f23-9fa8-011432d18543 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1808 microversion: 2.20 time: 0.202249 Dec 14 03:19:31.132596 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 361/692] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:19:30 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1808 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:19:31.863396 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-c08aec46-1f2e-4e39-b161-9c11027db33f tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:31.864029 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-c08aec46-1f2e-4e39-b161-9c11027db33f tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:31.870232 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c08aec46-1f2e-4e39-b161-9c11027db33f tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:31.870688 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c08aec46-1f2e-4e39-b161-9c11027db33f tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:31.871496 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c08aec46-1f2e-4e39-b161-9c11027db33f tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:31.872115 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c08aec46-1f2e-4e39-b161-9c11027db33f tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:31.905161 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c08aec46-1f2e-4e39-b161-9c11027db33f tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:31.905161 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c08aec46-1f2e-4e39-b161-9c11027db33f tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:31.905395 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.objects.instance [None req-c08aec46-1f2e-4e39-b161-9c11027db33f tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lazy-loading 'fault' on Instance uuid e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe {{(pid=116071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 14 03:19:31.946109 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-c08aec46-1f2e-4e39-b161-9c11027db33f tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:31.953951 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-c08aec46-1f2e-4e39-b161-9c11027db33f tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe" status: 200 len: 1307 microversion: 2.1 time: 0.094486 Dec 14 03:19:31.954871 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 332/693] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:19:31 2021] GET /compute/v2.1/servers/e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe => generated 1307 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:19:32.150009 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-8034033b-9fe6-4271-9494-c6134e00c91b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:32.150614 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-8034033b-9fe6-4271-9494-c6134e00c91b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:32.156861 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8034033b-9fe6-4271-9494-c6134e00c91b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:32.157310 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8034033b-9fe6-4271-9494-c6134e00c91b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:32.158078 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8034033b-9fe6-4271-9494-c6134e00c91b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:32.158512 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8034033b-9fe6-4271-9494-c6134e00c91b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:32.290217 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-8034033b-9fe6-4271-9494-c6134e00c91b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:32.298464 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-8034033b-9fe6-4271-9494-c6134e00c91b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:32.299985 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-8034033b-9fe6-4271-9494-c6134e00c91b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:32.301137 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-8034033b-9fe6-4271-9494-c6134e00c91b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1808 microversion: 2.20 time: 0.154774 Dec 14 03:19:32.301695 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 362/694] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:19:32 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:19:32.972778 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-12906395-4d80-40be-9e73-e0e2523b681e tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:32.973418 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-12906395-4d80-40be-9e73-e0e2523b681e tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:32.979457 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-12906395-4d80-40be-9e73-e0e2523b681e tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:32.979938 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-12906395-4d80-40be-9e73-e0e2523b681e tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:32.980726 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-12906395-4d80-40be-9e73-e0e2523b681e tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:32.981159 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-12906395-4d80-40be-9e73-e0e2523b681e tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:32.996625 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.wsgi [None req-12906395-4d80-40be-9e73-e0e2523b681e tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] HTTP exception thrown: Instance e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe could not be found. Dec 14 03:19:32.997220 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-12906395-4d80-40be-9e73-e0e2523b681e tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Returning 404 to user: Instance e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe could not be found. {{(pid=116071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 03:19:32.998039 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-12906395-4d80-40be-9e73-e0e2523b681e tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe" status: 404 len: 111 microversion: 2.1 time: 0.029434 Dec 14 03:19:32.998573 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 333/695] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:19:32 2021] GET /compute/v2.1/servers/e9ea21ad-4dcc-47f7-92ca-ead93cbb7efe => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 14 03:19:33.319999 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-a3058a16-55a2-4f16-b9d3-a53414334947 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:33.320740 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-a3058a16-55a2-4f16-b9d3-a53414334947 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:33.331098 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a3058a16-55a2-4f16-b9d3-a53414334947 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:33.331098 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a3058a16-55a2-4f16-b9d3-a53414334947 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:33.331098 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a3058a16-55a2-4f16-b9d3-a53414334947 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:33.331098 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a3058a16-55a2-4f16-b9d3-a53414334947 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:33.475587 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-a3058a16-55a2-4f16-b9d3-a53414334947 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:33.484249 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-a3058a16-55a2-4f16-b9d3-a53414334947 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:33.485743 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-a3058a16-55a2-4f16-b9d3-a53414334947 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:33.487442 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-a3058a16-55a2-4f16-b9d3-a53414334947 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1808 microversion: 2.20 time: 0.171154 Dec 14 03:19:33.488289 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 363/696] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:19:33 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:19:34.136917 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-170e5f6f-1d34-456b-bb76-bc665216786d tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:34.137459 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-170e5f6f-1d34-456b-bb76-bc665216786d tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: de04da40-f5fd-43e2-b454-20a219642030] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:34.143968 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-170e5f6f-1d34-456b-bb76-bc665216786d tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:34.145498 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-170e5f6f-1d34-456b-bb76-bc665216786d tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:34.146435 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-170e5f6f-1d34-456b-bb76-bc665216786d tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:34.146959 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-170e5f6f-1d34-456b-bb76-bc665216786d tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:34.172410 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-170e5f6f-1d34-456b-bb76-bc665216786d tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: de04da40-f5fd-43e2-b454-20a219642030] Going to try to terminate instance {{(pid=116071) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 14 03:19:34.244508 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-170e5f6f-1d34-456b-bb76-bc665216786d tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "DELETE /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030" status: 204 len: 0 microversion: 2.1 time: 0.110923 Dec 14 03:19:34.245093 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 334/697] 10.222.0.43 () {58 vars in 1238 bytes} [Tue Dec 14 03:19:34 2021] DELETE /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 14 03:19:34.253285 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-6daa3a2c-8aab-49b9-9de9-0772b5a48a1a tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:34.254244 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-6daa3a2c-8aab-49b9-9de9-0772b5a48a1a tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: de04da40-f5fd-43e2-b454-20a219642030] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:34.260207 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6daa3a2c-8aab-49b9-9de9-0772b5a48a1a tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:34.260663 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6daa3a2c-8aab-49b9-9de9-0772b5a48a1a tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:34.261446 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6daa3a2c-8aab-49b9-9de9-0772b5a48a1a tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:34.261882 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6daa3a2c-8aab-49b9-9de9-0772b5a48a1a tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:34.396788 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-6daa3a2c-8aab-49b9-9de9-0772b5a48a1a tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:34.407400 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-6daa3a2c-8aab-49b9-9de9-0772b5a48a1a tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030" status: 200 len: 1513 microversion: 2.1 time: 0.157781 Dec 14 03:19:34.408122 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 364/698] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:19:34 2021] GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030 => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:19:34.512218 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-ed12a69d-d0c7-4aca-ac41-443d139b757a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:34.512218 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-ed12a69d-d0c7-4aca-ac41-443d139b757a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:34.515091 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ed12a69d-d0c7-4aca-ac41-443d139b757a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:34.515622 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ed12a69d-d0c7-4aca-ac41-443d139b757a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:34.517996 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ed12a69d-d0c7-4aca-ac41-443d139b757a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:34.518588 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ed12a69d-d0c7-4aca-ac41-443d139b757a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:34.729094 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-ed12a69d-d0c7-4aca-ac41-443d139b757a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:34.737687 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-ed12a69d-d0c7-4aca-ac41-443d139b757a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:34.739503 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-ed12a69d-d0c7-4aca-ac41-443d139b757a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:34.740666 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-ed12a69d-d0c7-4aca-ac41-443d139b757a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1808 microversion: 2.20 time: 0.238707 Dec 14 03:19:34.741246 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 335/699] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:19:34 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1808 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:19:35.425912 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-f6a9f13d-7bc4-40a1-8c72-78337a2741c2 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:35.426615 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-f6a9f13d-7bc4-40a1-8c72-78337a2741c2 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: de04da40-f5fd-43e2-b454-20a219642030] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:35.433327 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f6a9f13d-7bc4-40a1-8c72-78337a2741c2 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:35.433787 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f6a9f13d-7bc4-40a1-8c72-78337a2741c2 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:35.434582 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f6a9f13d-7bc4-40a1-8c72-78337a2741c2 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:35.435020 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f6a9f13d-7bc4-40a1-8c72-78337a2741c2 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:35.578862 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-f6a9f13d-7bc4-40a1-8c72-78337a2741c2 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:35.587104 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-f6a9f13d-7bc4-40a1-8c72-78337a2741c2 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030" status: 200 len: 1513 microversion: 2.1 time: 0.165196 Dec 14 03:19:35.587678 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 365/700] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:19:35 2021] GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030 => generated 1513 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:19:35.759362 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-b81a44b1-4b59-4bf7-9182-9a7ee68f73e8 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:35.760166 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-b81a44b1-4b59-4bf7-9182-9a7ee68f73e8 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:35.767157 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b81a44b1-4b59-4bf7-9182-9a7ee68f73e8 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:35.767809 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b81a44b1-4b59-4bf7-9182-9a7ee68f73e8 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:35.768840 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b81a44b1-4b59-4bf7-9182-9a7ee68f73e8 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:35.769376 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b81a44b1-4b59-4bf7-9182-9a7ee68f73e8 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:35.907251 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-b81a44b1-4b59-4bf7-9182-9a7ee68f73e8 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:35.921777 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-b81a44b1-4b59-4bf7-9182-9a7ee68f73e8 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:35.923560 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-b81a44b1-4b59-4bf7-9182-9a7ee68f73e8 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:35.925389 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-b81a44b1-4b59-4bf7-9182-9a7ee68f73e8 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1808 microversion: 2.20 time: 0.169657 Dec 14 03:19:35.925965 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 336/701] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:19:35 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:19:36.603840 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-77810c10-4ae6-4d3f-83bc-45861fe3525e tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:36.604447 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-77810c10-4ae6-4d3f-83bc-45861fe3525e tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: de04da40-f5fd-43e2-b454-20a219642030] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:36.610523 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-77810c10-4ae6-4d3f-83bc-45861fe3525e tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:36.610969 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-77810c10-4ae6-4d3f-83bc-45861fe3525e tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:36.611768 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-77810c10-4ae6-4d3f-83bc-45861fe3525e tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:36.612198 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-77810c10-4ae6-4d3f-83bc-45861fe3525e tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:36.743071 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-77810c10-4ae6-4d3f-83bc-45861fe3525e tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:36.750198 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-77810c10-4ae6-4d3f-83bc-45861fe3525e tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030" status: 200 len: 1513 microversion: 2.1 time: 0.149976 Dec 14 03:19:36.750750 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 366/702] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:19:36 2021] GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030 => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:19:36.943861 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-330e3fb1-2664-4fea-b89f-0c1b4c7cffbb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:36.944501 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-330e3fb1-2664-4fea-b89f-0c1b4c7cffbb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:36.950696 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-330e3fb1-2664-4fea-b89f-0c1b4c7cffbb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:36.951184 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-330e3fb1-2664-4fea-b89f-0c1b4c7cffbb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:36.953788 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-330e3fb1-2664-4fea-b89f-0c1b4c7cffbb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:36.953788 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-330e3fb1-2664-4fea-b89f-0c1b4c7cffbb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:37.114018 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-330e3fb1-2664-4fea-b89f-0c1b4c7cffbb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:37.122278 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-330e3fb1-2664-4fea-b89f-0c1b4c7cffbb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:37.123896 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-330e3fb1-2664-4fea-b89f-0c1b4c7cffbb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:37.125154 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-330e3fb1-2664-4fea-b89f-0c1b4c7cffbb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1808 microversion: 2.20 time: 0.185180 Dec 14 03:19:37.125735 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 337/703] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:19:36 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1808 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:19:37.766763 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-9801c705-2bef-4c3f-bb7f-285e9f19e313 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:37.768011 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-9801c705-2bef-4c3f-bb7f-285e9f19e313 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: de04da40-f5fd-43e2-b454-20a219642030] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:37.774535 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9801c705-2bef-4c3f-bb7f-285e9f19e313 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:37.774987 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9801c705-2bef-4c3f-bb7f-285e9f19e313 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:37.775798 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9801c705-2bef-4c3f-bb7f-285e9f19e313 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:37.776236 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9801c705-2bef-4c3f-bb7f-285e9f19e313 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:37.905648 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-9801c705-2bef-4c3f-bb7f-285e9f19e313 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:37.912945 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-9801c705-2bef-4c3f-bb7f-285e9f19e313 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030" status: 200 len: 1513 microversion: 2.1 time: 0.149848 Dec 14 03:19:37.913448 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 367/704] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:19:37 2021] GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030 => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 03:19:38.144043 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-f652be76-b62c-4a58-bfe3-4fc23657b3cb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:38.144654 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-f652be76-b62c-4a58-bfe3-4fc23657b3cb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:38.150858 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-f652be76-b62c-4a58-bfe3-4fc23657b3cb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:38.151339 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-f652be76-b62c-4a58-bfe3-4fc23657b3cb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:38.152121 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-f652be76-b62c-4a58-bfe3-4fc23657b3cb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:38.152563 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-f652be76-b62c-4a58-bfe3-4fc23657b3cb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:38.283084 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-f652be76-b62c-4a58-bfe3-4fc23657b3cb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:38.291703 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-f652be76-b62c-4a58-bfe3-4fc23657b3cb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:38.293182 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-f652be76-b62c-4a58-bfe3-4fc23657b3cb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:38.294320 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-f652be76-b62c-4a58-bfe3-4fc23657b3cb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1808 microversion: 2.20 time: 0.153968 Dec 14 03:19:38.294864 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 338/705] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:19:38 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:19:38.930148 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-86082b68-9584-4d11-95b6-b27de8af415a tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:38.930688 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-86082b68-9584-4d11-95b6-b27de8af415a tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: de04da40-f5fd-43e2-b454-20a219642030] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:38.936865 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-86082b68-9584-4d11-95b6-b27de8af415a tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:38.937312 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-86082b68-9584-4d11-95b6-b27de8af415a tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:38.938100 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-86082b68-9584-4d11-95b6-b27de8af415a tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:38.938531 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-86082b68-9584-4d11-95b6-b27de8af415a tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:39.063422 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-86082b68-9584-4d11-95b6-b27de8af415a tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:39.071178 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-86082b68-9584-4d11-95b6-b27de8af415a tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030" status: 200 len: 1513 microversion: 2.1 time: 0.144652 Dec 14 03:19:39.071741 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 368/706] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:19:38 2021] GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030 => generated 1513 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:19:39.313391 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-692e9c87-b14d-457e-87fb-c1d730269f89 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:39.314001 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-692e9c87-b14d-457e-87fb-c1d730269f89 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:39.320322 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-692e9c87-b14d-457e-87fb-c1d730269f89 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:39.320767 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-692e9c87-b14d-457e-87fb-c1d730269f89 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:39.321541 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-692e9c87-b14d-457e-87fb-c1d730269f89 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:39.321977 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-692e9c87-b14d-457e-87fb-c1d730269f89 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:39.457258 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-692e9c87-b14d-457e-87fb-c1d730269f89 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:39.465668 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-692e9c87-b14d-457e-87fb-c1d730269f89 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:39.467164 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-692e9c87-b14d-457e-87fb-c1d730269f89 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:39.468313 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-692e9c87-b14d-457e-87fb-c1d730269f89 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1808 microversion: 2.20 time: 0.158623 Dec 14 03:19:39.468868 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 339/707] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:19:39 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:19:40.088528 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-3c48bdc3-4e61-42f5-9be5-05533c008829 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:40.089148 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-3c48bdc3-4e61-42f5-9be5-05533c008829 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: de04da40-f5fd-43e2-b454-20a219642030] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:40.095407 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3c48bdc3-4e61-42f5-9be5-05533c008829 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:40.095865 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3c48bdc3-4e61-42f5-9be5-05533c008829 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:40.096646 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3c48bdc3-4e61-42f5-9be5-05533c008829 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:40.097085 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3c48bdc3-4e61-42f5-9be5-05533c008829 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:40.235929 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-3c48bdc3-4e61-42f5-9be5-05533c008829 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:40.244020 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-3c48bdc3-4e61-42f5-9be5-05533c008829 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030" status: 200 len: 1513 microversion: 2.1 time: 0.159082 Dec 14 03:19:40.244577 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 369/708] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:19:40 2021] GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030 => generated 1513 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:19:40.488203 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-5f8705f0-4f00-49cc-8fb9-e5b9ec0020ec tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:40.488870 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-5f8705f0-4f00-49cc-8fb9-e5b9ec0020ec tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:40.495318 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-5f8705f0-4f00-49cc-8fb9-e5b9ec0020ec tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:40.495803 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-5f8705f0-4f00-49cc-8fb9-e5b9ec0020ec tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:40.496594 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-5f8705f0-4f00-49cc-8fb9-e5b9ec0020ec tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:40.497039 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-5f8705f0-4f00-49cc-8fb9-e5b9ec0020ec tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:40.630433 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-5f8705f0-4f00-49cc-8fb9-e5b9ec0020ec tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:40.639272 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-5f8705f0-4f00-49cc-8fb9-e5b9ec0020ec tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:40.641268 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-5f8705f0-4f00-49cc-8fb9-e5b9ec0020ec tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:40.642541 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-5f8705f0-4f00-49cc-8fb9-e5b9ec0020ec tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1808 microversion: 2.20 time: 0.158940 Dec 14 03:19:40.643755 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 340/709] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:19:40 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:19:41.261230 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-03e0e5d4-7fc0-46be-bca9-8165664449cf tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:41.261851 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-03e0e5d4-7fc0-46be-bca9-8165664449cf tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: de04da40-f5fd-43e2-b454-20a219642030] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:41.268802 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-03e0e5d4-7fc0-46be-bca9-8165664449cf tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:41.269249 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-03e0e5d4-7fc0-46be-bca9-8165664449cf tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:41.270028 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-03e0e5d4-7fc0-46be-bca9-8165664449cf tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:41.270465 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-03e0e5d4-7fc0-46be-bca9-8165664449cf tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:41.399165 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-03e0e5d4-7fc0-46be-bca9-8165664449cf tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:41.406371 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-03e0e5d4-7fc0-46be-bca9-8165664449cf tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030" status: 200 len: 1513 microversion: 2.1 time: 0.148749 Dec 14 03:19:41.406933 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 370/710] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:19:41 2021] GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030 => generated 1513 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:19:41.660853 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-b8173dd3-167e-41a2-99c2-8612f32c6282 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:41.661461 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-b8173dd3-167e-41a2-99c2-8612f32c6282 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:41.667664 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b8173dd3-167e-41a2-99c2-8612f32c6282 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:41.668114 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b8173dd3-167e-41a2-99c2-8612f32c6282 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:41.668886 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b8173dd3-167e-41a2-99c2-8612f32c6282 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:41.669320 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b8173dd3-167e-41a2-99c2-8612f32c6282 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:41.794943 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-b8173dd3-167e-41a2-99c2-8612f32c6282 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:41.803800 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-b8173dd3-167e-41a2-99c2-8612f32c6282 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:41.805288 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-b8173dd3-167e-41a2-99c2-8612f32c6282 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:41.806438 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-b8173dd3-167e-41a2-99c2-8612f32c6282 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1808 microversion: 2.20 time: 0.149299 Dec 14 03:19:41.806998 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 341/711] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:19:41 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1808 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 14 03:19:42.422580 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-0d66994b-ab55-470b-8ecf-9b016593861b tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:42.423226 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-0d66994b-ab55-470b-8ecf-9b016593861b tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: de04da40-f5fd-43e2-b454-20a219642030] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:42.429499 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0d66994b-ab55-470b-8ecf-9b016593861b tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:42.429951 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0d66994b-ab55-470b-8ecf-9b016593861b tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:42.430739 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0d66994b-ab55-470b-8ecf-9b016593861b tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:42.431208 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0d66994b-ab55-470b-8ecf-9b016593861b tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:42.558145 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-0d66994b-ab55-470b-8ecf-9b016593861b tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:42.565832 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-0d66994b-ab55-470b-8ecf-9b016593861b tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030" status: 200 len: 1513 microversion: 2.1 time: 0.147028 Dec 14 03:19:42.566387 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 371/712] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:19:42 2021] GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030 => generated 1513 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:19:42.824450 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-a51dddd0-c463-4a1d-9c21-24c46deed997 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:42.825069 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-a51dddd0-c463-4a1d-9c21-24c46deed997 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:42.831396 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a51dddd0-c463-4a1d-9c21-24c46deed997 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:42.831856 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a51dddd0-c463-4a1d-9c21-24c46deed997 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:42.832641 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a51dddd0-c463-4a1d-9c21-24c46deed997 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:42.833081 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a51dddd0-c463-4a1d-9c21-24c46deed997 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:42.960148 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-a51dddd0-c463-4a1d-9c21-24c46deed997 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:42.968460 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-a51dddd0-c463-4a1d-9c21-24c46deed997 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:42.969962 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-a51dddd0-c463-4a1d-9c21-24c46deed997 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:42.971814 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-a51dddd0-c463-4a1d-9c21-24c46deed997 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1808 microversion: 2.20 time: 0.150409 Dec 14 03:19:42.972383 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 342/713] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:19:42 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1808 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:19:43.582936 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-53288a7f-a739-4368-9880-ba13e659b91b tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:43.583575 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-53288a7f-a739-4368-9880-ba13e659b91b tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: de04da40-f5fd-43e2-b454-20a219642030] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:43.589773 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-53288a7f-a739-4368-9880-ba13e659b91b tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:43.590215 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-53288a7f-a739-4368-9880-ba13e659b91b tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:43.590978 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-53288a7f-a739-4368-9880-ba13e659b91b tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:43.591433 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-53288a7f-a739-4368-9880-ba13e659b91b tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:43.717974 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-53288a7f-a739-4368-9880-ba13e659b91b tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:43.725082 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-53288a7f-a739-4368-9880-ba13e659b91b tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030" status: 200 len: 1513 microversion: 2.1 time: 0.146379 Dec 14 03:19:43.725640 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 372/714] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:19:43 2021] GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030 => generated 1513 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:19:43.990427 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-d16f6981-90b3-454a-b876-3efe0f61d3a9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:43.991186 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-d16f6981-90b3-454a-b876-3efe0f61d3a9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:43.997604 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-d16f6981-90b3-454a-b876-3efe0f61d3a9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:43.998050 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-d16f6981-90b3-454a-b876-3efe0f61d3a9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:43.998819 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-d16f6981-90b3-454a-b876-3efe0f61d3a9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:43.999284 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-d16f6981-90b3-454a-b876-3efe0f61d3a9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:44.135763 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-d16f6981-90b3-454a-b876-3efe0f61d3a9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:44.146038 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-d16f6981-90b3-454a-b876-3efe0f61d3a9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:44.147779 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-d16f6981-90b3-454a-b876-3efe0f61d3a9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:44.149266 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-d16f6981-90b3-454a-b876-3efe0f61d3a9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1808 microversion: 2.20 time: 0.163204 Dec 14 03:19:44.151548 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 343/715] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:19:43 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:19:44.742465 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-ac243b78-280c-437a-a102-ffe6b7a73814 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:44.743205 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-ac243b78-280c-437a-a102-ffe6b7a73814 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: de04da40-f5fd-43e2-b454-20a219642030] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:44.749882 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ac243b78-280c-437a-a102-ffe6b7a73814 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:44.750434 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ac243b78-280c-437a-a102-ffe6b7a73814 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:44.751262 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ac243b78-280c-437a-a102-ffe6b7a73814 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:44.751697 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ac243b78-280c-437a-a102-ffe6b7a73814 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:44.884795 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-ac243b78-280c-437a-a102-ffe6b7a73814 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:44.892033 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-ac243b78-280c-437a-a102-ffe6b7a73814 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030" status: 200 len: 1513 microversion: 2.1 time: 0.153821 Dec 14 03:19:44.892588 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 373/716] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:19:44 2021] GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030 => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:19:45.169552 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-53bdc01c-fa0a-4b01-8ec2-483667e3cd03 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:45.170177 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-53bdc01c-fa0a-4b01-8ec2-483667e3cd03 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:45.176425 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-53bdc01c-fa0a-4b01-8ec2-483667e3cd03 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:45.176875 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-53bdc01c-fa0a-4b01-8ec2-483667e3cd03 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:45.177650 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-53bdc01c-fa0a-4b01-8ec2-483667e3cd03 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:45.178085 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-53bdc01c-fa0a-4b01-8ec2-483667e3cd03 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:45.321057 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-53bdc01c-fa0a-4b01-8ec2-483667e3cd03 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:45.329141 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-53bdc01c-fa0a-4b01-8ec2-483667e3cd03 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:45.330621 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-53bdc01c-fa0a-4b01-8ec2-483667e3cd03 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:45.331788 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-53bdc01c-fa0a-4b01-8ec2-483667e3cd03 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1808 microversion: 2.20 time: 0.165983 Dec 14 03:19:45.332342 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 344/717] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:19:45 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:19:45.908562 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-c1d197c6-a3a7-4700-84e7-ae0fbb855c94 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:45.909206 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-c1d197c6-a3a7-4700-84e7-ae0fbb855c94 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: de04da40-f5fd-43e2-b454-20a219642030] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:45.915542 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c1d197c6-a3a7-4700-84e7-ae0fbb855c94 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:45.915940 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c1d197c6-a3a7-4700-84e7-ae0fbb855c94 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:45.916714 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c1d197c6-a3a7-4700-84e7-ae0fbb855c94 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:45.917154 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c1d197c6-a3a7-4700-84e7-ae0fbb855c94 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:46.043777 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-c1d197c6-a3a7-4700-84e7-ae0fbb855c94 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:46.051532 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-c1d197c6-a3a7-4700-84e7-ae0fbb855c94 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030" status: 200 len: 1513 microversion: 2.1 time: 0.146602 Dec 14 03:19:46.052091 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 374/718] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:19:45 2021] GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030 => generated 1513 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:19:46.350285 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-0a4af9e2-de72-43b2-af8e-0b4a79dd7f0c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:46.350892 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-0a4af9e2-de72-43b2-af8e-0b4a79dd7f0c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:46.357160 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-0a4af9e2-de72-43b2-af8e-0b4a79dd7f0c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:46.357612 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-0a4af9e2-de72-43b2-af8e-0b4a79dd7f0c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:46.358383 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-0a4af9e2-de72-43b2-af8e-0b4a79dd7f0c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:46.358819 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-0a4af9e2-de72-43b2-af8e-0b4a79dd7f0c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:46.485454 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-0a4af9e2-de72-43b2-af8e-0b4a79dd7f0c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:46.493781 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-0a4af9e2-de72-43b2-af8e-0b4a79dd7f0c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:46.495304 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-0a4af9e2-de72-43b2-af8e-0b4a79dd7f0c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:46.496448 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-0a4af9e2-de72-43b2-af8e-0b4a79dd7f0c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1808 microversion: 2.20 time: 0.150285 Dec 14 03:19:46.497002 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 345/719] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:19:46 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1808 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:19:47.069780 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-a1216764-7713-45c2-8032-79accfb48971 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:47.070395 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-a1216764-7713-45c2-8032-79accfb48971 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: de04da40-f5fd-43e2-b454-20a219642030] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:47.076629 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a1216764-7713-45c2-8032-79accfb48971 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:47.077077 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a1216764-7713-45c2-8032-79accfb48971 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:47.077850 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a1216764-7713-45c2-8032-79accfb48971 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:47.078283 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a1216764-7713-45c2-8032-79accfb48971 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:47.205853 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-a1216764-7713-45c2-8032-79accfb48971 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:47.213004 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-a1216764-7713-45c2-8032-79accfb48971 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030" status: 200 len: 1513 microversion: 2.1 time: 0.147693 Dec 14 03:19:47.213564 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 375/720] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:19:47 2021] GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030 => generated 1513 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:19:47.515621 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-a151ec93-f4ec-42b2-89d0-ce27f76b21e9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:47.516265 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-a151ec93-f4ec-42b2-89d0-ce27f76b21e9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:47.522574 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a151ec93-f4ec-42b2-89d0-ce27f76b21e9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:47.523022 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a151ec93-f4ec-42b2-89d0-ce27f76b21e9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:47.523820 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a151ec93-f4ec-42b2-89d0-ce27f76b21e9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:47.524252 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a151ec93-f4ec-42b2-89d0-ce27f76b21e9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:47.667468 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-a151ec93-f4ec-42b2-89d0-ce27f76b21e9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:47.677463 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-a151ec93-f4ec-42b2-89d0-ce27f76b21e9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:47.678940 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-a151ec93-f4ec-42b2-89d0-ce27f76b21e9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:47.680108 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-a151ec93-f4ec-42b2-89d0-ce27f76b21e9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1808 microversion: 2.20 time: 0.168432 Dec 14 03:19:47.680657 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 346/721] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:19:47 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:19:48.230005 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-f4b87ff1-6e46-485b-9bac-308f878bf7b1 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:48.230693 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-f4b87ff1-6e46-485b-9bac-308f878bf7b1 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: de04da40-f5fd-43e2-b454-20a219642030] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:48.237070 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f4b87ff1-6e46-485b-9bac-308f878bf7b1 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:48.237525 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f4b87ff1-6e46-485b-9bac-308f878bf7b1 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:48.238579 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f4b87ff1-6e46-485b-9bac-308f878bf7b1 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:48.239017 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f4b87ff1-6e46-485b-9bac-308f878bf7b1 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:48.384338 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-f4b87ff1-6e46-485b-9bac-308f878bf7b1 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:48.391603 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-f4b87ff1-6e46-485b-9bac-308f878bf7b1 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030" status: 200 len: 1513 microversion: 2.1 time: 0.165863 Dec 14 03:19:48.392163 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 376/722] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:19:48 2021] GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030 => generated 1513 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:19:48.698035 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-84072162-0af2-4331-91b5-a3aabc6ad184 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:48.699147 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-84072162-0af2-4331-91b5-a3aabc6ad184 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:48.705801 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-84072162-0af2-4331-91b5-a3aabc6ad184 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:48.706249 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-84072162-0af2-4331-91b5-a3aabc6ad184 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:48.707062 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-84072162-0af2-4331-91b5-a3aabc6ad184 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:48.707518 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-84072162-0af2-4331-91b5-a3aabc6ad184 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:48.857394 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-84072162-0af2-4331-91b5-a3aabc6ad184 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:48.866467 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-84072162-0af2-4331-91b5-a3aabc6ad184 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:48.868001 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-84072162-0af2-4331-91b5-a3aabc6ad184 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:48.869164 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-84072162-0af2-4331-91b5-a3aabc6ad184 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1808 microversion: 2.20 time: 0.174879 Dec 14 03:19:48.869722 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 347/723] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:19:48 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:19:49.407988 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-e150b298-fb6d-4a84-bea8-5a14f813c1cf tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:49.408692 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-e150b298-fb6d-4a84-bea8-5a14f813c1cf tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: de04da40-f5fd-43e2-b454-20a219642030] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:49.415435 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e150b298-fb6d-4a84-bea8-5a14f813c1cf tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:49.415884 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e150b298-fb6d-4a84-bea8-5a14f813c1cf tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:49.416650 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e150b298-fb6d-4a84-bea8-5a14f813c1cf tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:49.417075 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e150b298-fb6d-4a84-bea8-5a14f813c1cf tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:49.551606 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-e150b298-fb6d-4a84-bea8-5a14f813c1cf tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:49.559183 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-e150b298-fb6d-4a84-bea8-5a14f813c1cf tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030" status: 200 len: 1513 microversion: 2.1 time: 0.154713 Dec 14 03:19:49.559950 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 377/724] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:19:49 2021] GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030 => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:19:49.887485 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-8ea788da-90eb-41a4-8e7f-87615c73bbb8 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:49.888103 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-8ea788da-90eb-41a4-8e7f-87615c73bbb8 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:49.894935 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-8ea788da-90eb-41a4-8e7f-87615c73bbb8 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:49.895417 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-8ea788da-90eb-41a4-8e7f-87615c73bbb8 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:49.896202 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-8ea788da-90eb-41a4-8e7f-87615c73bbb8 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:49.896644 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-8ea788da-90eb-41a4-8e7f-87615c73bbb8 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:50.029502 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-8ea788da-90eb-41a4-8e7f-87615c73bbb8 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:50.037566 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-8ea788da-90eb-41a4-8e7f-87615c73bbb8 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:50.039073 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-8ea788da-90eb-41a4-8e7f-87615c73bbb8 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:50.040220 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-8ea788da-90eb-41a4-8e7f-87615c73bbb8 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1808 microversion: 2.20 time: 0.156491 Dec 14 03:19:50.040775 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 348/725] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:19:49 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:19:50.576450 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-615fcd63-9317-43b4-8203-56a9d1876d68 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:50.577053 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-615fcd63-9317-43b4-8203-56a9d1876d68 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: de04da40-f5fd-43e2-b454-20a219642030] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:50.583412 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-615fcd63-9317-43b4-8203-56a9d1876d68 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:50.583869 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-615fcd63-9317-43b4-8203-56a9d1876d68 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:50.584659 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-615fcd63-9317-43b4-8203-56a9d1876d68 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:50.585100 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-615fcd63-9317-43b4-8203-56a9d1876d68 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:50.725753 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-615fcd63-9317-43b4-8203-56a9d1876d68 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:50.733004 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-615fcd63-9317-43b4-8203-56a9d1876d68 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030" status: 200 len: 1513 microversion: 2.1 time: 0.160218 Dec 14 03:19:50.733565 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 378/726] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:19:50 2021] GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030 => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:19:51.161023 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-b5ca300b-ad37-464c-9d1f-6e64f5205633 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:51.161646 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-b5ca300b-ad37-464c-9d1f-6e64f5205633 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:51.167920 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b5ca300b-ad37-464c-9d1f-6e64f5205633 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:51.168380 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b5ca300b-ad37-464c-9d1f-6e64f5205633 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:51.169176 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b5ca300b-ad37-464c-9d1f-6e64f5205633 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:51.169617 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b5ca300b-ad37-464c-9d1f-6e64f5205633 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:51.305224 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-b5ca300b-ad37-464c-9d1f-6e64f5205633 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:51.313391 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-b5ca300b-ad37-464c-9d1f-6e64f5205633 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:51.314877 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-b5ca300b-ad37-464c-9d1f-6e64f5205633 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:51.316000 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-b5ca300b-ad37-464c-9d1f-6e64f5205633 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1808 microversion: 2.20 time: 0.262226 Dec 14 03:19:51.316555 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 349/727] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:19:51 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1808 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:19:51.749559 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-87495e44-d020-4b2c-9c2e-88f6b1497699 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:51.750197 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-87495e44-d020-4b2c-9c2e-88f6b1497699 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: de04da40-f5fd-43e2-b454-20a219642030] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:51.756691 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-87495e44-d020-4b2c-9c2e-88f6b1497699 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:51.757146 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-87495e44-d020-4b2c-9c2e-88f6b1497699 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:51.757926 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-87495e44-d020-4b2c-9c2e-88f6b1497699 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:51.758368 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-87495e44-d020-4b2c-9c2e-88f6b1497699 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:51.890278 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-87495e44-d020-4b2c-9c2e-88f6b1497699 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:51.898010 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-87495e44-d020-4b2c-9c2e-88f6b1497699 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030" status: 200 len: 1513 microversion: 2.1 time: 0.152273 Dec 14 03:19:51.898579 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 379/728] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:19:51 2021] GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030 => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:19:52.334325 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-a6c062d8-c91a-46eb-a394-9f4fb4dc0155 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:52.335032 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-a6c062d8-c91a-46eb-a394-9f4fb4dc0155 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:52.341146 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a6c062d8-c91a-46eb-a394-9f4fb4dc0155 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:52.341593 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a6c062d8-c91a-46eb-a394-9f4fb4dc0155 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:52.342371 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a6c062d8-c91a-46eb-a394-9f4fb4dc0155 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:52.342807 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a6c062d8-c91a-46eb-a394-9f4fb4dc0155 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:52.484624 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-a6c062d8-c91a-46eb-a394-9f4fb4dc0155 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:52.494488 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-a6c062d8-c91a-46eb-a394-9f4fb4dc0155 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:52.496122 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-a6c062d8-c91a-46eb-a394-9f4fb4dc0155 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:52.497407 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-a6c062d8-c91a-46eb-a394-9f4fb4dc0155 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1808 microversion: 2.20 time: 0.167453 Dec 14 03:19:52.498031 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 350/729] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:19:52 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:19:52.915638 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-cc4128c4-278b-4750-952f-9b03bf48812c tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:52.916388 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-cc4128c4-278b-4750-952f-9b03bf48812c tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: de04da40-f5fd-43e2-b454-20a219642030] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:52.924278 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-cc4128c4-278b-4750-952f-9b03bf48812c tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:52.924940 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-cc4128c4-278b-4750-952f-9b03bf48812c tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:52.926043 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-cc4128c4-278b-4750-952f-9b03bf48812c tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:52.926638 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-cc4128c4-278b-4750-952f-9b03bf48812c tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:53.069740 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-cc4128c4-278b-4750-952f-9b03bf48812c tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:53.077239 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-cc4128c4-278b-4750-952f-9b03bf48812c tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030" status: 200 len: 1513 microversion: 2.1 time: 0.165329 Dec 14 03:19:53.077815 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 380/730] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:19:52 2021] GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030 => generated 1513 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:19:53.515840 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-cb40d456-2990-4a03-9c66-fcda1cbddddc tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:53.516557 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-cb40d456-2990-4a03-9c66-fcda1cbddddc tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:53.523204 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-cb40d456-2990-4a03-9c66-fcda1cbddddc tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:53.523662 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-cb40d456-2990-4a03-9c66-fcda1cbddddc tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:53.524453 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-cb40d456-2990-4a03-9c66-fcda1cbddddc tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:53.524897 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-cb40d456-2990-4a03-9c66-fcda1cbddddc tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:53.666382 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-cb40d456-2990-4a03-9c66-fcda1cbddddc tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:53.681891 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-cb40d456-2990-4a03-9c66-fcda1cbddddc tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:53.683947 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-cb40d456-2990-4a03-9c66-fcda1cbddddc tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:53.685403 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-cb40d456-2990-4a03-9c66-fcda1cbddddc tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1808 microversion: 2.20 time: 0.173525 Dec 14 03:19:53.697541 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 351/731] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:19:53 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1808 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:19:54.095907 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-f5c26d7c-d358-47e7-8da8-b42bc5b48123 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:54.097037 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-f5c26d7c-d358-47e7-8da8-b42bc5b48123 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: de04da40-f5fd-43e2-b454-20a219642030] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:54.103769 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f5c26d7c-d358-47e7-8da8-b42bc5b48123 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:54.104224 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f5c26d7c-d358-47e7-8da8-b42bc5b48123 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:54.105015 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f5c26d7c-d358-47e7-8da8-b42bc5b48123 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:54.105456 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f5c26d7c-d358-47e7-8da8-b42bc5b48123 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:54.258326 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-f5c26d7c-d358-47e7-8da8-b42bc5b48123 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:54.265715 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-f5c26d7c-d358-47e7-8da8-b42bc5b48123 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030" status: 200 len: 1513 microversion: 2.1 time: 0.173377 Dec 14 03:19:54.266281 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 381/732] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:19:54 2021] GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030 => generated 1513 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:19:54.704616 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-14010277-d458-4b9a-84f3-31d9d6871b71 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:54.705223 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-14010277-d458-4b9a-84f3-31d9d6871b71 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:54.711883 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-14010277-d458-4b9a-84f3-31d9d6871b71 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:54.712347 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-14010277-d458-4b9a-84f3-31d9d6871b71 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:54.713147 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-14010277-d458-4b9a-84f3-31d9d6871b71 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:54.713587 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-14010277-d458-4b9a-84f3-31d9d6871b71 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:54.917001 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-14010277-d458-4b9a-84f3-31d9d6871b71 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:54.926590 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-14010277-d458-4b9a-84f3-31d9d6871b71 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:54.928112 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-14010277-d458-4b9a-84f3-31d9d6871b71 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:54.929267 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-14010277-d458-4b9a-84f3-31d9d6871b71 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1808 microversion: 2.20 time: 0.228450 Dec 14 03:19:54.929822 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 352/733] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:19:54 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1808 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:19:55.282682 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-31a261e0-5bfc-4cd6-81c8-a42c07fdb09b tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:55.283365 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-31a261e0-5bfc-4cd6-81c8-a42c07fdb09b tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: de04da40-f5fd-43e2-b454-20a219642030] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:55.289437 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-31a261e0-5bfc-4cd6-81c8-a42c07fdb09b tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:55.289901 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-31a261e0-5bfc-4cd6-81c8-a42c07fdb09b tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:55.290658 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-31a261e0-5bfc-4cd6-81c8-a42c07fdb09b tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:55.291116 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-31a261e0-5bfc-4cd6-81c8-a42c07fdb09b tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:55.424372 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-31a261e0-5bfc-4cd6-81c8-a42c07fdb09b tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:55.432194 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-31a261e0-5bfc-4cd6-81c8-a42c07fdb09b tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030" status: 200 len: 1513 microversion: 2.1 time: 0.153101 Dec 14 03:19:55.432754 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 382/734] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:19:55 2021] GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030 => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:19:55.947562 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-ae0c6ca8-18aa-4f83-bbb9-826f979e5e7c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:55.948114 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-ae0c6ca8-18aa-4f83-bbb9-826f979e5e7c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:55.954938 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ae0c6ca8-18aa-4f83-bbb9-826f979e5e7c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:55.955469 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ae0c6ca8-18aa-4f83-bbb9-826f979e5e7c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:55.956233 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ae0c6ca8-18aa-4f83-bbb9-826f979e5e7c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:55.956673 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ae0c6ca8-18aa-4f83-bbb9-826f979e5e7c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:56.092684 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-ae0c6ca8-18aa-4f83-bbb9-826f979e5e7c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:56.101603 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-ae0c6ca8-18aa-4f83-bbb9-826f979e5e7c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:56.103139 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-ae0c6ca8-18aa-4f83-bbb9-826f979e5e7c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:56.104302 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-ae0c6ca8-18aa-4f83-bbb9-826f979e5e7c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1808 microversion: 2.20 time: 0.160737 Dec 14 03:19:56.104855 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 353/735] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:19:55 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:19:56.450977 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-bbfcae91-eede-4fc6-b5f4-7be37edce602 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:56.451599 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-bbfcae91-eede-4fc6-b5f4-7be37edce602 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: de04da40-f5fd-43e2-b454-20a219642030] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:56.457919 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-bbfcae91-eede-4fc6-b5f4-7be37edce602 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:56.458361 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-bbfcae91-eede-4fc6-b5f4-7be37edce602 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:56.459169 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-bbfcae91-eede-4fc6-b5f4-7be37edce602 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:56.459598 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-bbfcae91-eede-4fc6-b5f4-7be37edce602 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:56.600329 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-bbfcae91-eede-4fc6-b5f4-7be37edce602 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:56.608700 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-bbfcae91-eede-4fc6-b5f4-7be37edce602 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030" status: 200 len: 1513 microversion: 2.1 time: 0.162843 Dec 14 03:19:56.611341 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 383/736] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:19:56 2021] GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030 => generated 1513 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:19:57.124087 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-2ddc37c7-47f6-411e-a21d-dcf078fc2c37 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:57.124756 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-2ddc37c7-47f6-411e-a21d-dcf078fc2c37 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:57.131794 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-2ddc37c7-47f6-411e-a21d-dcf078fc2c37 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:57.132274 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-2ddc37c7-47f6-411e-a21d-dcf078fc2c37 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:57.133050 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-2ddc37c7-47f6-411e-a21d-dcf078fc2c37 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:57.133486 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-2ddc37c7-47f6-411e-a21d-dcf078fc2c37 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:57.264479 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-2ddc37c7-47f6-411e-a21d-dcf078fc2c37 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:57.273061 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-2ddc37c7-47f6-411e-a21d-dcf078fc2c37 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:57.274531 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-2ddc37c7-47f6-411e-a21d-dcf078fc2c37 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:57.275714 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-2ddc37c7-47f6-411e-a21d-dcf078fc2c37 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1808 microversion: 2.20 time: 0.155392 Dec 14 03:19:57.276320 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 354/737] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:19:57 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:19:57.625463 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-61ecd247-31fe-4337-87e2-e6125ecf2a56 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:57.626075 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-61ecd247-31fe-4337-87e2-e6125ecf2a56 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: de04da40-f5fd-43e2-b454-20a219642030] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:57.633121 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-61ecd247-31fe-4337-87e2-e6125ecf2a56 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:57.633570 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-61ecd247-31fe-4337-87e2-e6125ecf2a56 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:57.634335 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-61ecd247-31fe-4337-87e2-e6125ecf2a56 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:57.634766 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-61ecd247-31fe-4337-87e2-e6125ecf2a56 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:57.766013 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-61ecd247-31fe-4337-87e2-e6125ecf2a56 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:57.773907 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-61ecd247-31fe-4337-87e2-e6125ecf2a56 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030" status: 200 len: 1513 microversion: 2.1 time: 0.152052 Dec 14 03:19:57.774628 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 384/738] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:19:57 2021] GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030 => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:19:58.294867 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-cc9ed400-6649-420e-8ddf-66485d3fec84 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:58.295416 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-cc9ed400-6649-420e-8ddf-66485d3fec84 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:58.301203 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-cc9ed400-6649-420e-8ddf-66485d3fec84 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:58.301662 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-cc9ed400-6649-420e-8ddf-66485d3fec84 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:58.302438 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-cc9ed400-6649-420e-8ddf-66485d3fec84 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:58.302880 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-cc9ed400-6649-420e-8ddf-66485d3fec84 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:58.432124 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-cc9ed400-6649-420e-8ddf-66485d3fec84 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:58.440228 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-cc9ed400-6649-420e-8ddf-66485d3fec84 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:58.442622 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-cc9ed400-6649-420e-8ddf-66485d3fec84 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:58.443434 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-cc9ed400-6649-420e-8ddf-66485d3fec84 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1808 microversion: 2.20 time: 0.152425 Dec 14 03:19:58.443985 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 355/739] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:19:58 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:19:58.791396 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-4af03487-0cea-43b5-98e0-a5c7a4f29f09 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:58.791984 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-4af03487-0cea-43b5-98e0-a5c7a4f29f09 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: de04da40-f5fd-43e2-b454-20a219642030] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:58.798158 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4af03487-0cea-43b5-98e0-a5c7a4f29f09 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:58.798604 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4af03487-0cea-43b5-98e0-a5c7a4f29f09 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:58.799433 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4af03487-0cea-43b5-98e0-a5c7a4f29f09 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:58.799865 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4af03487-0cea-43b5-98e0-a5c7a4f29f09 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:58.926464 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-4af03487-0cea-43b5-98e0-a5c7a4f29f09 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:58.933551 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-4af03487-0cea-43b5-98e0-a5c7a4f29f09 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030" status: 200 len: 1513 microversion: 2.1 time: 0.145759 Dec 14 03:19:58.934104 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 385/740] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:19:58 2021] GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030 => generated 1513 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:19:59.462156 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-9170397a-a66d-485d-bccd-ecdd3192e4aa tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:59.462818 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-9170397a-a66d-485d-bccd-ecdd3192e4aa tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:59.477949 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-9170397a-a66d-485d-bccd-ecdd3192e4aa tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:59.478408 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-9170397a-a66d-485d-bccd-ecdd3192e4aa tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:59.480592 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-9170397a-a66d-485d-bccd-ecdd3192e4aa tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:59.481232 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-9170397a-a66d-485d-bccd-ecdd3192e4aa tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:59.629024 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-9170397a-a66d-485d-bccd-ecdd3192e4aa tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:59.637082 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-9170397a-a66d-485d-bccd-ecdd3192e4aa tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:59.638599 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-9170397a-a66d-485d-bccd-ecdd3192e4aa tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:19:59.639728 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-9170397a-a66d-485d-bccd-ecdd3192e4aa tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1808 microversion: 2.20 time: 0.181304 Dec 14 03:19:59.640469 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 356/741] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:19:59 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1808 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:19:59.673397 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [req-9469b902-ac84-49fd-b898-affe330847e8 req-1352e6f4-8d1d-4194-90ed-d230fd319f0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de04da40-f5fd-43e2-b454-20a219642030", "name": "network-vif-deleted", "tag": "b60f528b-8a43-4d0c-83ea-77e6e41b0fe5"}]} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:19:59.674940 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:19:59.674940 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: warnings.warn(msg) Dec 14 03:19:59.682630 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-9469b902-ac84-49fd-b898-affe330847e8 req-1352e6f4-8d1d-4194-90ed-d230fd319f0e service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:59.683097 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-9469b902-ac84-49fd-b898-affe330847e8 req-1352e6f4-8d1d-4194-90ed-d230fd319f0e service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:59.695627 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.compute.server_external_events [req-9469b902-ac84-49fd-b898-affe330847e8 req-1352e6f4-8d1d-4194-90ed-d230fd319f0e service nova] Creating event network-vif-deleted:b60f528b-8a43-4d0c-83ea-77e6e41b0fe5 for instance de04da40-f5fd-43e2-b454-20a219642030 on hv-cinder-81803 Dec 14 03:19:59.700424 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [req-9469b902-ac84-49fd-b898-affe330847e8 req-1352e6f4-8d1d-4194-90ed-d230fd319f0e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.179632 Dec 14 03:19:59.701204 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 386/742] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Dec 14 03:19:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:19:59.950881 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-604d4a9c-0384-4c07-b72f-ae9475f14c01 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:19:59.951538 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-604d4a9c-0384-4c07-b72f-ae9475f14c01 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: de04da40-f5fd-43e2-b454-20a219642030] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:19:59.957533 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-604d4a9c-0384-4c07-b72f-ae9475f14c01 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:59.958011 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-604d4a9c-0384-4c07-b72f-ae9475f14c01 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:59.958795 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-604d4a9c-0384-4c07-b72f-ae9475f14c01 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:59.959316 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-604d4a9c-0384-4c07-b72f-ae9475f14c01 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:59.991820 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-604d4a9c-0384-4c07-b72f-ae9475f14c01 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:19:59.992299 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-604d4a9c-0384-4c07-b72f-ae9475f14c01 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:19:59.992755 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.objects.instance [None req-604d4a9c-0384-4c07-b72f-ae9475f14c01 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lazy-loading 'fault' on Instance uuid de04da40-f5fd-43e2-b454-20a219642030 {{(pid=116071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 14 03:20:00.035489 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-604d4a9c-0384-4c07-b72f-ae9475f14c01 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a133cb1175e4130902bbcdeaedd74f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ecea5c13a624ab8a3a445d3ede5fd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:20:00.043087 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-604d4a9c-0384-4c07-b72f-ae9475f14c01 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030" status: 200 len: 1307 microversion: 2.1 time: 0.095812 Dec 14 03:20:00.043670 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 357/743] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:19:59 2021] GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030 => generated 1307 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:20:00.658964 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-1f76215d-d21e-400b-bd75-eb374d39cee5 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:20:00.659695 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-1f76215d-d21e-400b-bd75-eb374d39cee5 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:20:00.666945 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1f76215d-d21e-400b-bd75-eb374d39cee5 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:00.667419 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1f76215d-d21e-400b-bd75-eb374d39cee5 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:00.668195 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1f76215d-d21e-400b-bd75-eb374d39cee5 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:00.668627 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1f76215d-d21e-400b-bd75-eb374d39cee5 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:00.798488 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-1f76215d-d21e-400b-bd75-eb374d39cee5 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:20:00.807456 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-1f76215d-d21e-400b-bd75-eb374d39cee5 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:20:00.809242 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-1f76215d-d21e-400b-bd75-eb374d39cee5 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:20:00.810405 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-1f76215d-d21e-400b-bd75-eb374d39cee5 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1808 microversion: 2.20 time: 0.155448 Dec 14 03:20:00.810958 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 387/744] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:20:00 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:20:01.060274 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-f4b4345b-3402-4069-8579-8ebd24c2ff52 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:20:01.060919 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-f4b4345b-3402-4069-8579-8ebd24c2ff52 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] [instance: de04da40-f5fd-43e2-b454-20a219642030] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:20:01.067791 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-f4b4345b-3402-4069-8579-8ebd24c2ff52 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:01.068770 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-f4b4345b-3402-4069-8579-8ebd24c2ff52 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:01.069795 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-f4b4345b-3402-4069-8579-8ebd24c2ff52 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:01.070241 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-f4b4345b-3402-4069-8579-8ebd24c2ff52 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:01.084910 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.wsgi [None req-f4b4345b-3402-4069-8579-8ebd24c2ff52 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] HTTP exception thrown: Instance de04da40-f5fd-43e2-b454-20a219642030 could not be found. Dec 14 03:20:01.085507 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-f4b4345b-3402-4069-8579-8ebd24c2ff52 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] Returning 404 to user: Instance de04da40-f5fd-43e2-b454-20a219642030 could not be found. {{(pid=116071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 03:20:01.086326 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-f4b4345b-3402-4069-8579-8ebd24c2ff52 tempest-AttachVolumeNegativeTest-682724683 tempest-AttachVolumeNegativeTest-682724683-project] 10.222.0.43 "GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030" status: 404 len: 111 microversion: 2.1 time: 0.029741 Dec 14 03:20:01.086865 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 358/745] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:20:01 2021] GET /compute/v2.1/servers/de04da40-f5fd-43e2-b454-20a219642030 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 14 03:20:01.829491 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-5f161be3-5288-4fa0-aada-b77446e6d844 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:20:01.831262 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-5f161be3-5288-4fa0-aada-b77446e6d844 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:20:01.838136 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5f161be3-5288-4fa0-aada-b77446e6d844 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:01.838683 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5f161be3-5288-4fa0-aada-b77446e6d844 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:01.839579 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5f161be3-5288-4fa0-aada-b77446e6d844 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:01.840082 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5f161be3-5288-4fa0-aada-b77446e6d844 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:02.044419 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-5f161be3-5288-4fa0-aada-b77446e6d844 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:20:02.055330 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-5f161be3-5288-4fa0-aada-b77446e6d844 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:20:02.056882 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-5f161be3-5288-4fa0-aada-b77446e6d844 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:20:02.058052 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-5f161be3-5288-4fa0-aada-b77446e6d844 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1808 microversion: 2.20 time: 0.232129 Dec 14 03:20:02.058696 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 388/746] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:20:01 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1808 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:20:03.077872 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-ce7d8d82-f7f8-44ab-8cd4-fdc42b2da285 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:20:03.079246 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-ce7d8d82-f7f8-44ab-8cd4-fdc42b2da285 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:20:03.086252 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ce7d8d82-f7f8-44ab-8cd4-fdc42b2da285 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:03.086871 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ce7d8d82-f7f8-44ab-8cd4-fdc42b2da285 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:03.087944 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ce7d8d82-f7f8-44ab-8cd4-fdc42b2da285 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:03.088531 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ce7d8d82-f7f8-44ab-8cd4-fdc42b2da285 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:03.229591 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-ce7d8d82-f7f8-44ab-8cd4-fdc42b2da285 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:20:03.238371 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-ce7d8d82-f7f8-44ab-8cd4-fdc42b2da285 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:20:03.239890 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-ce7d8d82-f7f8-44ab-8cd4-fdc42b2da285 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:20:03.241030 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-ce7d8d82-f7f8-44ab-8cd4-fdc42b2da285 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1808 microversion: 2.20 time: 0.167276 Dec 14 03:20:03.241576 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 389/747] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:20:03 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:20:03.306746 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-c67a766b-d1c3-4a3d-801e-07adc98bd864 tempest-VolumesSnapshotsTestJSON-239668139 tempest-VolumesSnapshotsTestJSON-239668139-project] Action: 'create', calling method: .version_select at 0x7fa50368aca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1667362031"}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:20:03.598162 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-c67a766b-d1c3-4a3d-801e-07adc98bd864 tempest-VolumesSnapshotsTestJSON-239668139 tempest-VolumesSnapshotsTestJSON-239668139-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.544589 Dec 14 03:20:03.598716 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 359/748] 10.222.0.43 () {60 vars in 1154 bytes} [Tue Dec 14 03:20:03 2021] POST /compute/v2.1/os-volumes => generated 345 bytes in 546 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Dec 14 03:20:03.609172 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-72061236-05f5-4cf4-bac7-d77d64df6537 tempest-VolumesSnapshotsTestJSON-239668139 tempest-VolumesSnapshotsTestJSON-239668139-project] Calling method '.version_select at 0x7fa5035a4670>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:20:03.658728 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-72061236-05f5-4cf4-bac7-d77d64df6537 tempest-VolumesSnapshotsTestJSON-239668139 tempest-VolumesSnapshotsTestJSON-239668139-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/3bd0625e-0eb4-4759-b625-080d9100163f" status: 200 len: 345 microversion: 2.1 time: 0.053027 Dec 14 03:20:03.662437 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 390/749] 10.222.0.43 () {58 vars in 1244 bytes} [Tue Dec 14 03:20:03 2021] GET /compute/v2.1/os-volumes/3bd0625e-0eb4-4759-b625-080d9100163f => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:20:04.261556 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-a89e41c7-cdf4-4ee9-adb7-cbdd4772a110 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:20:04.262482 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-a89e41c7-cdf4-4ee9-adb7-cbdd4772a110 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:20:04.269343 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a89e41c7-cdf4-4ee9-adb7-cbdd4772a110 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:04.269854 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a89e41c7-cdf4-4ee9-adb7-cbdd4772a110 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:04.270609 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a89e41c7-cdf4-4ee9-adb7-cbdd4772a110 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:04.271058 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a89e41c7-cdf4-4ee9-adb7-cbdd4772a110 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:04.428092 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-a89e41c7-cdf4-4ee9-adb7-cbdd4772a110 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:20:04.437718 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-a89e41c7-cdf4-4ee9-adb7-cbdd4772a110 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:20:04.439265 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-a89e41c7-cdf4-4ee9-adb7-cbdd4772a110 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:20:04.440468 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-a89e41c7-cdf4-4ee9-adb7-cbdd4772a110 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1808 microversion: 2.20 time: 0.184631 Dec 14 03:20:04.441558 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 360/750] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:20:04 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1808 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:20:04.671694 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-bcf8f8d1-a29b-4cdf-89b3-a9e736f7cfdf tempest-VolumesSnapshotsTestJSON-239668139 tempest-VolumesSnapshotsTestJSON-239668139-project] Calling method '.version_select at 0x7fa5035b4f70>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:20:04.721635 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-bcf8f8d1-a29b-4cdf-89b3-a9e736f7cfdf tempest-VolumesSnapshotsTestJSON-239668139 tempest-VolumesSnapshotsTestJSON-239668139-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/3bd0625e-0eb4-4759-b625-080d9100163f" status: 200 len: 346 microversion: 2.1 time: 0.053945 Dec 14 03:20:04.723056 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 391/751] 10.222.0.43 () {58 vars in 1244 bytes} [Tue Dec 14 03:20:04 2021] GET /compute/v2.1/os-volumes/3bd0625e-0eb4-4759-b625-080d9100163f => generated 346 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:20:04.733708 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-a9cbdf62-9ce6-451f-88c8-470b82e37767 tempest-VolumesSnapshotsTestJSON-239668139 tempest-VolumesSnapshotsTestJSON-239668139-project] Action: 'create', calling method: .version_select at 0x7fa50368a0d0>, body: {"snapshot": {"volume_id": "3bd0625e-0eb4-4759-b625-080d9100163f", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-715609081"}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:20:04.888202 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-a9cbdf62-9ce6-451f-88c8-470b82e37767 tempest-VolumesSnapshotsTestJSON-239668139 tempest-VolumesSnapshotsTestJSON-239668139-project] 10.222.0.43 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.158081 Dec 14 03:20:04.888874 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 361/752] 10.222.0.43 () {60 vars in 1161 bytes} [Tue Dec 14 03:20:04 2021] POST /compute/v2.1/os-snapshots => generated 286 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:20:04.899125 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-254d2797-55f2-49ba-b8d6-b0de3065571c tempest-VolumesSnapshotsTestJSON-239668139 tempest-VolumesSnapshotsTestJSON-239668139-project] Calling method '.version_select at 0x7fa50354d670>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:20:04.928130 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-254d2797-55f2-49ba-b8d6-b0de3065571c tempest-VolumesSnapshotsTestJSON-239668139 tempest-VolumesSnapshotsTestJSON-239668139-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/fc26e228-a318-4b1b-9306-7161af029eb0" status: 200 len: 286 microversion: 2.1 time: 0.033249 Dec 14 03:20:04.928743 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 392/753] 10.222.0.43 () {58 vars in 1250 bytes} [Tue Dec 14 03:20:04 2021] GET /compute/v2.1/os-snapshots/fc26e228-a318-4b1b-9306-7161af029eb0 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:20:04.938632 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-25b82af2-8913-4dc0-9fb1-be3688c059ae tempest-VolumesSnapshotsTestJSON-239668139 tempest-VolumesSnapshotsTestJSON-239668139-project] Calling method '.version_select at 0x7fa50376fa60>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:20:04.967958 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-25b82af2-8913-4dc0-9fb1-be3688c059ae tempest-VolumesSnapshotsTestJSON-239668139 tempest-VolumesSnapshotsTestJSON-239668139-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.032887 Dec 14 03:20:04.968506 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 362/754] 10.222.0.43 () {58 vars in 1139 bytes} [Tue Dec 14 03:20:04 2021] GET /compute/v2.1/os-snapshots => generated 289 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:20:04.978759 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-a2562cd7-ab2b-4fd5-be72-f3ecf2c99485 tempest-VolumesSnapshotsTestJSON-239668139 tempest-VolumesSnapshotsTestJSON-239668139-project] Calling method '.version_select at 0x7fa50354dd30>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:20:05.007921 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-a2562cd7-ab2b-4fd5-be72-f3ecf2c99485 tempest-VolumesSnapshotsTestJSON-239668139 tempest-VolumesSnapshotsTestJSON-239668139-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/fc26e228-a318-4b1b-9306-7161af029eb0" status: 200 len: 286 microversion: 2.1 time: 0.032663 Dec 14 03:20:05.008471 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 393/755] 10.222.0.43 () {58 vars in 1250 bytes} [Tue Dec 14 03:20:04 2021] GET /compute/v2.1/os-snapshots/fc26e228-a318-4b1b-9306-7161af029eb0 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:20:05.461221 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-0363c0c4-b37e-4c78-8a99-b1f75bd32bcc tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:20:05.461833 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-0363c0c4-b37e-4c78-8a99-b1f75bd32bcc tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:20:05.468353 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-0363c0c4-b37e-4c78-8a99-b1f75bd32bcc tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:05.468807 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-0363c0c4-b37e-4c78-8a99-b1f75bd32bcc tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:05.469585 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-0363c0c4-b37e-4c78-8a99-b1f75bd32bcc tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:05.470024 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-0363c0c4-b37e-4c78-8a99-b1f75bd32bcc tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:05.601462 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-0363c0c4-b37e-4c78-8a99-b1f75bd32bcc tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:20:05.610947 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-0363c0c4-b37e-4c78-8a99-b1f75bd32bcc tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:20:05.612583 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-0363c0c4-b37e-4c78-8a99-b1f75bd32bcc tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:20:05.614112 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-0363c0c4-b37e-4c78-8a99-b1f75bd32bcc tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1808 microversion: 2.20 time: 0.157447 Dec 14 03:20:05.614555 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 363/756] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:20:05 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:20:05.926730 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-e65dff24-fcdd-41c6-8187-062e709c2b5e tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1861494571", "imageRef": "4fff76a9-6620-4bda-b1ec-2cd3719c946a", "flavorRef": "452", "networks": [{"uuid": "72a1ba60-29fb-46d5-ae0c-f4c2277490a8"}]}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:20:05.977063 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.network.neutron [None req-e65dff24-fcdd-41c6-8187-062e709c2b5e tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] validate_networks() for [('72a1ba60-29fb-46d5-ae0c-f4c2277490a8', None, None, None, None, None)] {{(pid=116072) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 14 03:20:06.019535 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-d5f4934a-1368-4279-882a-bc50dfcded58 tempest-VolumesSnapshotsTestJSON-239668139 tempest-VolumesSnapshotsTestJSON-239668139-project] Calling method '.version_select at 0x7fa5036ceb80>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:20:06.049448 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-d5f4934a-1368-4279-882a-bc50dfcded58 tempest-VolumesSnapshotsTestJSON-239668139 tempest-VolumesSnapshotsTestJSON-239668139-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/fc26e228-a318-4b1b-9306-7161af029eb0" status: 200 len: 286 microversion: 2.1 time: 0.033575 Dec 14 03:20:06.050004 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 364/757] 10.222.0.43 () {58 vars in 1250 bytes} [Tue Dec 14 03:20:06 2021] GET /compute/v2.1/os-snapshots/fc26e228-a318-4b1b-9306-7161af029eb0 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 14 03:20:06.348927 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-e65dff24-fcdd-41c6-8187-062e709c2b5e tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Flavor limits 0:0:0 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 14 03:20:06.349356 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-e65dff24-fcdd-41c6-8187-062e709c2b5e tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Image limits 0:0:0 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 14 03:20:06.349826 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-e65dff24-fcdd-41c6-8187-062e709c2b5e tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Flavor pref 0:0:0 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 14 03:20:06.350233 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-e65dff24-fcdd-41c6-8187-062e709c2b5e tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Image pref 0:0:0 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 14 03:20:06.350643 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-e65dff24-fcdd-41c6-8187-062e709c2b5e tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 14 03:20:06.359277 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e65dff24-fcdd-41c6-8187-062e709c2b5e tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:06.359733 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e65dff24-fcdd-41c6-8187-062e709c2b5e tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:06.360545 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e65dff24-fcdd-41c6-8187-062e709c2b5e tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:06.360980 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e65dff24-fcdd-41c6-8187-062e709c2b5e tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:06.377728 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.quota [None req-e65dff24-fcdd-41c6-8187-062e709c2b5e tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Getting quotas for project 325c78a0c8574ce0bb38f768705a1181. Resources: {'cores', 'instances', 'ram'} {{(pid=116072) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 03:20:06.382197 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.quota [None req-e65dff24-fcdd-41c6-8187-062e709c2b5e tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Getting quotas for user e9bfec4b3f8b47cf93f7d07703365d1a and project 325c78a0c8574ce0bb38f768705a1181. Resources: {'cores', 'instances', 'ram'} {{(pid=116072) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 03:20:06.392871 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-e65dff24-fcdd-41c6-8187-062e709c2b5e tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Going to run 1 instances... {{(pid=116072) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 14 03:20:06.395206 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-e65dff24-fcdd-41c6-8187-062e709c2b5e tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] [instance: 90cacc35-5115-4b8c-b108-eff10fd63c6f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4fff76a9-6620-4bda-b1ec-2cd3719c946a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 14 03:20:06.437067 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-e65dff24-fcdd-41c6-8187-062e709c2b5e tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.514989 Dec 14 03:20:06.437707 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 394/758] 10.222.0.43 () {60 vars in 1146 bytes} [Tue Dec 14 03:20:05 2021] POST /compute/v2.1/servers => generated 380 bytes in 516 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 14 03:20:06.447830 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-9c2c379f-6cf4-4402-91a1-26c4a7e3b746 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:20:06.448452 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-9c2c379f-6cf4-4402-91a1-26c4a7e3b746 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] [instance: 90cacc35-5115-4b8c-b108-eff10fd63c6f] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:20:06.506750 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-9c2c379f-6cf4-4402-91a1-26c4a7e3b746 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bfec4b3f8b47cf93f7d07703365d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325c78a0c8574ce0bb38f768705a1181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:20:06.513765 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-9c2c379f-6cf4-4402-91a1-26c4a7e3b746 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /compute/v2.1/servers/90cacc35-5115-4b8c-b108-eff10fd63c6f" status: 200 len: 1219 microversion: 2.1 time: 0.069508 Dec 14 03:20:06.514321 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 365/759] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:20:06 2021] GET /compute/v2.1/servers/90cacc35-5115-4b8c-b108-eff10fd63c6f => generated 1219 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:20:06.631248 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-d580004a-f18c-4478-b1f5-0dedb5e40613 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:20:06.631860 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-d580004a-f18c-4478-b1f5-0dedb5e40613 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:20:06.638528 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d580004a-f18c-4478-b1f5-0dedb5e40613 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:06.638971 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d580004a-f18c-4478-b1f5-0dedb5e40613 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:06.639779 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d580004a-f18c-4478-b1f5-0dedb5e40613 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:06.640217 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d580004a-f18c-4478-b1f5-0dedb5e40613 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:06.780520 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-d580004a-f18c-4478-b1f5-0dedb5e40613 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:20:06.790117 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-d580004a-f18c-4478-b1f5-0dedb5e40613 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:20:06.791762 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-d580004a-f18c-4478-b1f5-0dedb5e40613 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:20:06.792966 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-d580004a-f18c-4478-b1f5-0dedb5e40613 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1808 microversion: 2.20 time: 0.165504 Dec 14 03:20:06.793702 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 395/760] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:20:06 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:20:07.060661 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-e68e0ed5-24ad-42ad-82c7-e376c1bc02e9 tempest-VolumesSnapshotsTestJSON-239668139 tempest-VolumesSnapshotsTestJSON-239668139-project] Calling method '.version_select at 0x7fa50811b550>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:20:07.089247 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-e68e0ed5-24ad-42ad-82c7-e376c1bc02e9 tempest-VolumesSnapshotsTestJSON-239668139 tempest-VolumesSnapshotsTestJSON-239668139-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/fc26e228-a318-4b1b-9306-7161af029eb0" status: 200 len: 286 microversion: 2.1 time: 0.032228 Dec 14 03:20:07.089788 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 366/761] 10.222.0.43 () {58 vars in 1250 bytes} [Tue Dec 14 03:20:07 2021] GET /compute/v2.1/os-snapshots/fc26e228-a318-4b1b-9306-7161af029eb0 => generated 286 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:20:07.530978 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-f4dd5f61-79ae-4ad3-9c71-491724aa4725 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:20:07.531640 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-f4dd5f61-79ae-4ad3-9c71-491724aa4725 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] [instance: 90cacc35-5115-4b8c-b108-eff10fd63c6f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:20:07.538392 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f4dd5f61-79ae-4ad3-9c71-491724aa4725 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:07.538840 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f4dd5f61-79ae-4ad3-9c71-491724aa4725 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:07.539639 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f4dd5f61-79ae-4ad3-9c71-491724aa4725 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:07.540071 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f4dd5f61-79ae-4ad3-9c71-491724aa4725 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:07.597813 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-f4dd5f61-79ae-4ad3-9c71-491724aa4725 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bfec4b3f8b47cf93f7d07703365d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325c78a0c8574ce0bb38f768705a1181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:20:07.604893 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-f4dd5f61-79ae-4ad3-9c71-491724aa4725 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /compute/v2.1/servers/90cacc35-5115-4b8c-b108-eff10fd63c6f" status: 200 len: 1223 microversion: 2.1 time: 0.077561 Dec 14 03:20:07.605468 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 396/762] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:20:07 2021] GET /compute/v2.1/servers/90cacc35-5115-4b8c-b108-eff10fd63c6f => generated 1223 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:20:07.813228 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-a4d35be2-4517-4879-b04f-49d437c737d3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:20:07.813856 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-a4d35be2-4517-4879-b04f-49d437c737d3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:20:07.819842 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a4d35be2-4517-4879-b04f-49d437c737d3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:07.820303 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a4d35be2-4517-4879-b04f-49d437c737d3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:07.821092 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a4d35be2-4517-4879-b04f-49d437c737d3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:07.821535 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a4d35be2-4517-4879-b04f-49d437c737d3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:07.948704 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-a4d35be2-4517-4879-b04f-49d437c737d3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:20:07.957470 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-a4d35be2-4517-4879-b04f-49d437c737d3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:20:07.958968 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-a4d35be2-4517-4879-b04f-49d437c737d3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:20:07.960138 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-a4d35be2-4517-4879-b04f-49d437c737d3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1808 microversion: 2.20 time: 0.151056 Dec 14 03:20:07.960692 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 367/763] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:20:07 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1808 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:20:08.103637 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-a067b7c3-bdb7-43e3-812c-eb88074019c8 tempest-VolumesSnapshotsTestJSON-239668139 tempest-VolumesSnapshotsTestJSON-239668139-project] Calling method '.version_select at 0x7fa50805b820>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:20:08.133262 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-a067b7c3-bdb7-43e3-812c-eb88074019c8 tempest-VolumesSnapshotsTestJSON-239668139 tempest-VolumesSnapshotsTestJSON-239668139-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/fc26e228-a318-4b1b-9306-7161af029eb0" status: 200 len: 286 microversion: 2.1 time: 0.035745 Dec 14 03:20:08.133817 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 397/764] 10.222.0.43 () {58 vars in 1250 bytes} [Tue Dec 14 03:20:08 2021] GET /compute/v2.1/os-snapshots/fc26e228-a318-4b1b-9306-7161af029eb0 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:20:08.621357 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-96c2e8a8-662b-461e-9987-a2c634d3b40b tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:20:08.621964 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-96c2e8a8-662b-461e-9987-a2c634d3b40b tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] [instance: 90cacc35-5115-4b8c-b108-eff10fd63c6f] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:20:08.627799 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-96c2e8a8-662b-461e-9987-a2c634d3b40b tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:08.628245 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-96c2e8a8-662b-461e-9987-a2c634d3b40b tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:08.629015 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-96c2e8a8-662b-461e-9987-a2c634d3b40b tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:08.629456 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-96c2e8a8-662b-461e-9987-a2c634d3b40b tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:08.689909 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-96c2e8a8-662b-461e-9987-a2c634d3b40b tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bfec4b3f8b47cf93f7d07703365d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325c78a0c8574ce0bb38f768705a1181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:20:08.697312 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-96c2e8a8-662b-461e-9987-a2c634d3b40b tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /compute/v2.1/servers/90cacc35-5115-4b8c-b108-eff10fd63c6f" status: 200 len: 1223 microversion: 2.1 time: 0.079511 Dec 14 03:20:08.697810 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 368/765] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:20:08 2021] GET /compute/v2.1/servers/90cacc35-5115-4b8c-b108-eff10fd63c6f => generated 1223 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:20:08.979122 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-9ee5a448-eac6-4d5f-9dd9-495245cef216 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:20:08.979866 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-9ee5a448-eac6-4d5f-9dd9-495245cef216 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:20:08.985885 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9ee5a448-eac6-4d5f-9dd9-495245cef216 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:08.986345 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9ee5a448-eac6-4d5f-9dd9-495245cef216 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:08.987150 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9ee5a448-eac6-4d5f-9dd9-495245cef216 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:08.988139 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9ee5a448-eac6-4d5f-9dd9-495245cef216 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:09.115990 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-9ee5a448-eac6-4d5f-9dd9-495245cef216 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:20:09.124144 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-9ee5a448-eac6-4d5f-9dd9-495245cef216 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:20:09.125644 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-9ee5a448-eac6-4d5f-9dd9-495245cef216 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:20:09.126792 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-9ee5a448-eac6-4d5f-9dd9-495245cef216 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1808 microversion: 2.20 time: 0.151827 Dec 14 03:20:09.127383 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 398/766] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:20:08 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:20:09.143604 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-59bbad4d-77ac-40b9-89cb-9a7e8444723f tempest-VolumesSnapshotsTestJSON-239668139 tempest-VolumesSnapshotsTestJSON-239668139-project] Calling method '.version_select at 0x7fa5037fa700>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:20:09.172181 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-59bbad4d-77ac-40b9-89cb-9a7e8444723f tempest-VolumesSnapshotsTestJSON-239668139 tempest-VolumesSnapshotsTestJSON-239668139-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/fc26e228-a318-4b1b-9306-7161af029eb0" status: 200 len: 286 microversion: 2.1 time: 0.032169 Dec 14 03:20:09.172720 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 369/767] 10.222.0.43 () {58 vars in 1250 bytes} [Tue Dec 14 03:20:09 2021] GET /compute/v2.1/os-snapshots/fc26e228-a318-4b1b-9306-7161af029eb0 => generated 286 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:20:09.713494 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-57b9c469-06f5-4f0e-8945-e1413f8af9ea tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:20:09.714109 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-57b9c469-06f5-4f0e-8945-e1413f8af9ea tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] [instance: 90cacc35-5115-4b8c-b108-eff10fd63c6f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:20:09.719904 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-57b9c469-06f5-4f0e-8945-e1413f8af9ea tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:09.720358 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-57b9c469-06f5-4f0e-8945-e1413f8af9ea tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:09.721129 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-57b9c469-06f5-4f0e-8945-e1413f8af9ea tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:09.721565 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-57b9c469-06f5-4f0e-8945-e1413f8af9ea tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:09.779420 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-57b9c469-06f5-4f0e-8945-e1413f8af9ea tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bfec4b3f8b47cf93f7d07703365d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325c78a0c8574ce0bb38f768705a1181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:20:09.786602 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-57b9c469-06f5-4f0e-8945-e1413f8af9ea tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /compute/v2.1/servers/90cacc35-5115-4b8c-b108-eff10fd63c6f" status: 200 len: 1271 microversion: 2.1 time: 0.076781 Dec 14 03:20:09.787217 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 399/768] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:20:09 2021] GET /compute/v2.1/servers/90cacc35-5115-4b8c-b108-eff10fd63c6f => generated 1271 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:20:10.146289 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-a0e4f3d4-891e-4835-966e-3404f0e3b013 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:20:10.146888 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-a0e4f3d4-891e-4835-966e-3404f0e3b013 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:20:10.153132 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a0e4f3d4-891e-4835-966e-3404f0e3b013 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:10.153583 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a0e4f3d4-891e-4835-966e-3404f0e3b013 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:10.154367 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a0e4f3d4-891e-4835-966e-3404f0e3b013 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:10.154935 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a0e4f3d4-891e-4835-966e-3404f0e3b013 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:10.183470 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-317c34d9-cdb2-41a5-91f1-84f56897906c tempest-VolumesSnapshotsTestJSON-239668139 tempest-VolumesSnapshotsTestJSON-239668139-project] Calling method '.version_select at 0x7fa5035b93a0>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:20:10.214544 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-317c34d9-cdb2-41a5-91f1-84f56897906c tempest-VolumesSnapshotsTestJSON-239668139 tempest-VolumesSnapshotsTestJSON-239668139-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/fc26e228-a318-4b1b-9306-7161af029eb0" status: 200 len: 287 microversion: 2.1 time: 0.034551 Dec 14 03:20:10.215351 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 400/769] 10.222.0.43 () {58 vars in 1250 bytes} [Tue Dec 14 03:20:10 2021] GET /compute/v2.1/os-snapshots/fc26e228-a318-4b1b-9306-7161af029eb0 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 14 03:20:10.224773 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-7a2ed736-4eba-4369-8ca5-9a59ccd297ab tempest-VolumesSnapshotsTestJSON-239668139 tempest-VolumesSnapshotsTestJSON-239668139-project] Calling method '.version_select at 0x7fa5035b45e0>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:20:10.282517 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-7a2ed736-4eba-4369-8ca5-9a59ccd297ab tempest-VolumesSnapshotsTestJSON-239668139 tempest-VolumesSnapshotsTestJSON-239668139-project] 10.222.0.43 "DELETE /compute/v2.1/os-snapshots/fc26e228-a318-4b1b-9306-7161af029eb0" status: 202 len: 0 microversion: 2.1 time: 0.061072 Dec 14 03:20:10.283012 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 401/770] 10.222.0.43 () {58 vars in 1253 bytes} [Tue Dec 14 03:20:10 2021] DELETE /compute/v2.1/os-snapshots/fc26e228-a318-4b1b-9306-7161af029eb0 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 14 03:20:10.290728 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-057ac518-50fb-48eb-80fd-ef9e98cd806d tempest-VolumesSnapshotsTestJSON-239668139 tempest-VolumesSnapshotsTestJSON-239668139-project] Calling method '.version_select at 0x7fa50354da60>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:20:10.305258 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-a0e4f3d4-891e-4835-966e-3404f0e3b013 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:20:10.315526 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-a0e4f3d4-891e-4835-966e-3404f0e3b013 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:20:10.318172 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-a0e4f3d4-891e-4835-966e-3404f0e3b013 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:20:10.319593 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-a0e4f3d4-891e-4835-966e-3404f0e3b013 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1808 microversion: 2.20 time: 0.177701 Dec 14 03:20:10.329503 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 370/771] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:20:10 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1808 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:20:10.338193 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-057ac518-50fb-48eb-80fd-ef9e98cd806d tempest-VolumesSnapshotsTestJSON-239668139 tempest-VolumesSnapshotsTestJSON-239668139-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/fc26e228-a318-4b1b-9306-7161af029eb0" status: 200 len: 286 microversion: 2.1 time: 0.050859 Dec 14 03:20:10.338757 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 402/772] 10.222.0.43 () {58 vars in 1250 bytes} [Tue Dec 14 03:20:10 2021] GET /compute/v2.1/os-snapshots/fc26e228-a318-4b1b-9306-7161af029eb0 => generated 286 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 14 03:20:10.804014 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-0b84f541-44bb-49d6-a7ab-565f6fb72137 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:20:10.804656 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-0b84f541-44bb-49d6-a7ab-565f6fb72137 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] [instance: 90cacc35-5115-4b8c-b108-eff10fd63c6f] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:20:10.810515 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-0b84f541-44bb-49d6-a7ab-565f6fb72137 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:10.810957 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-0b84f541-44bb-49d6-a7ab-565f6fb72137 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:10.811774 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-0b84f541-44bb-49d6-a7ab-565f6fb72137 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:10.812210 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-0b84f541-44bb-49d6-a7ab-565f6fb72137 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:10.945530 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-0b84f541-44bb-49d6-a7ab-565f6fb72137 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bfec4b3f8b47cf93f7d07703365d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325c78a0c8574ce0bb38f768705a1181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:20:10.952902 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-0b84f541-44bb-49d6-a7ab-565f6fb72137 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /compute/v2.1/servers/90cacc35-5115-4b8c-b108-eff10fd63c6f" status: 200 len: 1319 microversion: 2.1 time: 0.153071 Dec 14 03:20:10.953478 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 371/773] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:20:10 2021] GET /compute/v2.1/servers/90cacc35-5115-4b8c-b108-eff10fd63c6f => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:20:11.338446 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-337dafca-30e1-4855-b166-9a7db36ec8e9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:20:11.339104 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-337dafca-30e1-4855-b166-9a7db36ec8e9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:20:11.345707 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-337dafca-30e1-4855-b166-9a7db36ec8e9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:11.346161 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-337dafca-30e1-4855-b166-9a7db36ec8e9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:11.347540 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-337dafca-30e1-4855-b166-9a7db36ec8e9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:11.348021 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-337dafca-30e1-4855-b166-9a7db36ec8e9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:11.350294 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-a48ff155-af3f-4929-97c0-ca4f432e439d tempest-VolumesSnapshotsTestJSON-239668139 tempest-VolumesSnapshotsTestJSON-239668139-project] Calling method '.version_select at 0x7fa5037199d0>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:20:11.380757 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.wsgi [None req-a48ff155-af3f-4929-97c0-ca4f432e439d tempest-VolumesSnapshotsTestJSON-239668139 tempest-VolumesSnapshotsTestJSON-239668139-project] HTTP exception thrown: Snapshot fc26e228-a318-4b1b-9306-7161af029eb0 could not be found. Dec 14 03:20:11.381382 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-a48ff155-af3f-4929-97c0-ca4f432e439d tempest-VolumesSnapshotsTestJSON-239668139 tempest-VolumesSnapshotsTestJSON-239668139-project] Returning 404 to user: Snapshot fc26e228-a318-4b1b-9306-7161af029eb0 could not be found. {{(pid=116071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 03:20:11.382210 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-a48ff155-af3f-4929-97c0-ca4f432e439d tempest-VolumesSnapshotsTestJSON-239668139 tempest-VolumesSnapshotsTestJSON-239668139-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/fc26e228-a318-4b1b-9306-7161af029eb0" status: 404 len: 111 microversion: 2.1 time: 0.036530 Dec 14 03:20:11.382780 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 372/774] 10.222.0.43 () {58 vars in 1250 bytes} [Tue Dec 14 03:20:11 2021] GET /compute/v2.1/os-snapshots/fc26e228-a318-4b1b-9306-7161af029eb0 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 14 03:20:11.392233 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-02fd5336-253f-4c01-8dee-f1164d9277bd tempest-VolumesSnapshotsTestJSON-239668139 tempest-VolumesSnapshotsTestJSON-239668139-project] Calling method '.version_select at 0x7fa5036ac040>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:20:11.459511 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-02fd5336-253f-4c01-8dee-f1164d9277bd tempest-VolumesSnapshotsTestJSON-239668139 tempest-VolumesSnapshotsTestJSON-239668139-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/3bd0625e-0eb4-4759-b625-080d9100163f" status: 202 len: 0 microversion: 2.1 time: 0.071861 Dec 14 03:20:11.460358 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 373/775] 10.222.0.43 () {58 vars in 1247 bytes} [Tue Dec 14 03:20:11 2021] DELETE /compute/v2.1/os-volumes/3bd0625e-0eb4-4759-b625-080d9100163f => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:20:11.467727 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-d8cf16cc-8e97-410c-a8ae-ae46f257b0cc tempest-VolumesSnapshotsTestJSON-239668139 tempest-VolumesSnapshotsTestJSON-239668139-project] Calling method '.version_select at 0x7fa50820c310>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:20:11.498527 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-337dafca-30e1-4855-b166-9a7db36ec8e9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:20:11.508237 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-337dafca-30e1-4855-b166-9a7db36ec8e9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:20:11.509748 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-337dafca-30e1-4855-b166-9a7db36ec8e9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:20:11.510929 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-337dafca-30e1-4855-b166-9a7db36ec8e9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1808 microversion: 2.20 time: 0.176698 Dec 14 03:20:11.511546 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 403/776] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:20:11 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1808 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:20:11.521775 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-d8cf16cc-8e97-410c-a8ae-ae46f257b0cc tempest-VolumesSnapshotsTestJSON-239668139 tempest-VolumesSnapshotsTestJSON-239668139-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/3bd0625e-0eb4-4759-b625-080d9100163f" status: 200 len: 345 microversion: 2.1 time: 0.057332 Dec 14 03:20:11.522421 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 374/777] 10.222.0.43 () {58 vars in 1244 bytes} [Tue Dec 14 03:20:11 2021] GET /compute/v2.1/os-volumes/3bd0625e-0eb4-4759-b625-080d9100163f => generated 345 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 14 03:20:11.587426 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [req-53a342c6-272d-4fc6-8c08-74c7d36edd01 req-cf12e8aa-b1f7-4c94-b4be-5b9125ca05ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90cacc35-5115-4b8c-b108-eff10fd63c6f", "tag": "dfeb9ef9-1191-4547-92d0-4cdb5a44f9eb"}]} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:20:11.589124 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:20:11.589124 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: warnings.warn(msg) Dec 14 03:20:11.596405 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-53a342c6-272d-4fc6-8c08-74c7d36edd01 req-cf12e8aa-b1f7-4c94-b4be-5b9125ca05ca service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:11.597353 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-53a342c6-272d-4fc6-8c08-74c7d36edd01 req-cf12e8aa-b1f7-4c94-b4be-5b9125ca05ca service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:11.607989 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.compute.server_external_events [req-53a342c6-272d-4fc6-8c08-74c7d36edd01 req-cf12e8aa-b1f7-4c94-b4be-5b9125ca05ca service nova] Creating event network-changed:dfeb9ef9-1191-4547-92d0-4cdb5a44f9eb for instance 90cacc35-5115-4b8c-b108-eff10fd63c6f on hv-cinder-81803 Dec 14 03:20:11.613486 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [req-53a342c6-272d-4fc6-8c08-74c7d36edd01 req-cf12e8aa-b1f7-4c94-b4be-5b9125ca05ca service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035757 Dec 14 03:20:11.614076 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 404/778] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Dec 14 03:20:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:20:11.970633 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-aa33f464-6d67-4f39-875c-8d798b6aabdc tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:20:11.971623 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-aa33f464-6d67-4f39-875c-8d798b6aabdc tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] [instance: 90cacc35-5115-4b8c-b108-eff10fd63c6f] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:20:11.977979 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-aa33f464-6d67-4f39-875c-8d798b6aabdc tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:11.978431 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-aa33f464-6d67-4f39-875c-8d798b6aabdc tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:11.979250 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-aa33f464-6d67-4f39-875c-8d798b6aabdc tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:11.979708 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-aa33f464-6d67-4f39-875c-8d798b6aabdc tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:12.114303 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-aa33f464-6d67-4f39-875c-8d798b6aabdc tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bfec4b3f8b47cf93f7d07703365d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325c78a0c8574ce0bb38f768705a1181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:20:12.121838 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-aa33f464-6d67-4f39-875c-8d798b6aabdc tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /compute/v2.1/servers/90cacc35-5115-4b8c-b108-eff10fd63c6f" status: 200 len: 1319 microversion: 2.1 time: 0.155874 Dec 14 03:20:12.122817 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 375/779] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:20:11 2021] GET /compute/v2.1/servers/90cacc35-5115-4b8c-b108-eff10fd63c6f => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:20:12.378493 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [req-c0d8b427-a124-4af2-a278-43a2ddc386f0 req-30713918-d50d-4091-98a5-ef32bb9ac71a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86395107-d320-45d8-83de-f1848858be10", "name": "network-vif-plugged", "status": "completed", "tag": "85ceb16f-0c27-48e9-ab76-5cd49eb12802"}]} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:20:12.380309 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:20:12.380309 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: warnings.warn(msg) Dec 14 03:20:12.387426 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-c0d8b427-a124-4af2-a278-43a2ddc386f0 req-30713918-d50d-4091-98a5-ef32bb9ac71a service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:12.387953 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-c0d8b427-a124-4af2-a278-43a2ddc386f0 req-30713918-d50d-4091-98a5-ef32bb9ac71a service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:12.399364 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.compute.server_external_events [req-c0d8b427-a124-4af2-a278-43a2ddc386f0 req-30713918-d50d-4091-98a5-ef32bb9ac71a service nova] Creating event network-vif-plugged:85ceb16f-0c27-48e9-ab76-5cd49eb12802 for instance 86395107-d320-45d8-83de-f1848858be10 on hv-cinder-81803 Dec 14 03:20:12.404272 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [req-c0d8b427-a124-4af2-a278-43a2ddc386f0 req-30713918-d50d-4091-98a5-ef32bb9ac71a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153710 Dec 14 03:20:12.404873 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 405/780] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Dec 14 03:20:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:20:12.529999 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-87098c2c-0fb1-4b80-ad4f-37fcd6db56d0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:20:12.530540 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-87098c2c-0fb1-4b80-ad4f-37fcd6db56d0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:20:12.534249 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-6b96c026-f920-4c45-9339-b08957ecbe46 tempest-VolumesSnapshotsTestJSON-239668139 tempest-VolumesSnapshotsTestJSON-239668139-project] Calling method '.version_select at 0x7fa5036f0f70>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:20:12.537342 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-87098c2c-0fb1-4b80-ad4f-37fcd6db56d0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:12.537789 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-87098c2c-0fb1-4b80-ad4f-37fcd6db56d0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:12.538778 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-87098c2c-0fb1-4b80-ad4f-37fcd6db56d0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:12.539249 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-87098c2c-0fb1-4b80-ad4f-37fcd6db56d0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:12.564021 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.wsgi [None req-6b96c026-f920-4c45-9339-b08957ecbe46 tempest-VolumesSnapshotsTestJSON-239668139 tempest-VolumesSnapshotsTestJSON-239668139-project] HTTP exception thrown: Volume 3bd0625e-0eb4-4759-b625-080d9100163f could not be found. Dec 14 03:20:12.564626 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-6b96c026-f920-4c45-9339-b08957ecbe46 tempest-VolumesSnapshotsTestJSON-239668139 tempest-VolumesSnapshotsTestJSON-239668139-project] Returning 404 to user: Volume 3bd0625e-0eb4-4759-b625-080d9100163f could not be found. {{(pid=116072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 03:20:12.565517 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-6b96c026-f920-4c45-9339-b08957ecbe46 tempest-VolumesSnapshotsTestJSON-239668139 tempest-VolumesSnapshotsTestJSON-239668139-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/3bd0625e-0eb4-4759-b625-080d9100163f" status: 404 len: 109 microversion: 2.1 time: 0.035146 Dec 14 03:20:12.566201 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 406/781] 10.222.0.43 () {58 vars in 1244 bytes} [Tue Dec 14 03:20:12 2021] GET /compute/v2.1/os-volumes/3bd0625e-0eb4-4759-b625-080d9100163f => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 14 03:20:12.577218 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-e922eb52-9894-4d84-acc3-964ce1d64131 tempest-VolumesSnapshotsTestJSON-239668139 tempest-VolumesSnapshotsTestJSON-239668139-project] Calling method '.version_select at 0x7fa5035b9430>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:20:12.611184 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.wsgi [None req-e922eb52-9894-4d84-acc3-964ce1d64131 tempest-VolumesSnapshotsTestJSON-239668139 tempest-VolumesSnapshotsTestJSON-239668139-project] HTTP exception thrown: Volume 3bd0625e-0eb4-4759-b625-080d9100163f could not be found. Dec 14 03:20:12.611789 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-e922eb52-9894-4d84-acc3-964ce1d64131 tempest-VolumesSnapshotsTestJSON-239668139 tempest-VolumesSnapshotsTestJSON-239668139-project] Returning 404 to user: Volume 3bd0625e-0eb4-4759-b625-080d9100163f could not be found. {{(pid=116072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 03:20:12.612622 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-e922eb52-9894-4d84-acc3-964ce1d64131 tempest-VolumesSnapshotsTestJSON-239668139 tempest-VolumesSnapshotsTestJSON-239668139-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/3bd0625e-0eb4-4759-b625-080d9100163f" status: 404 len: 109 microversion: 2.1 time: 0.040892 Dec 14 03:20:12.613461 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 407/782] 10.222.0.43 () {58 vars in 1247 bytes} [Tue Dec 14 03:20:12 2021] DELETE /compute/v2.1/os-volumes/3bd0625e-0eb4-4759-b625-080d9100163f => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 14 03:20:12.620939 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-76eb9015-da2e-4e96-bb8f-57e57eaee271 tempest-VolumesSnapshotsTestJSON-239668139 tempest-VolumesSnapshotsTestJSON-239668139-project] Calling method '.version_select at 0x7fa5035a4f70>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:20:12.647536 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.wsgi [None req-76eb9015-da2e-4e96-bb8f-57e57eaee271 tempest-VolumesSnapshotsTestJSON-239668139 tempest-VolumesSnapshotsTestJSON-239668139-project] HTTP exception thrown: Volume 3bd0625e-0eb4-4759-b625-080d9100163f could not be found. Dec 14 03:20:12.648133 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-76eb9015-da2e-4e96-bb8f-57e57eaee271 tempest-VolumesSnapshotsTestJSON-239668139 tempest-VolumesSnapshotsTestJSON-239668139-project] Returning 404 to user: Volume 3bd0625e-0eb4-4759-b625-080d9100163f could not be found. {{(pid=116072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 03:20:12.648962 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-76eb9015-da2e-4e96-bb8f-57e57eaee271 tempest-VolumesSnapshotsTestJSON-239668139 tempest-VolumesSnapshotsTestJSON-239668139-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/3bd0625e-0eb4-4759-b625-080d9100163f" status: 404 len: 109 microversion: 2.1 time: 0.031472 Dec 14 03:20:12.649500 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 408/783] 10.222.0.43 () {58 vars in 1244 bytes} [Tue Dec 14 03:20:12 2021] GET /compute/v2.1/os-volumes/3bd0625e-0eb4-4759-b625-080d9100163f => generated 109 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 14 03:20:12.675971 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-87098c2c-0fb1-4b80-ad4f-37fcd6db56d0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:20:12.684014 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-87098c2c-0fb1-4b80-ad4f-37fcd6db56d0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:20:12.685491 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-87098c2c-0fb1-4b80-ad4f-37fcd6db56d0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:20:12.686630 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-87098c2c-0fb1-4b80-ad4f-37fcd6db56d0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1808 microversion: 2.20 time: 0.160630 Dec 14 03:20:12.687298 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 376/784] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:20:12 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:20:13.139854 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-c926d777-0428-491c-94a2-2bc5fd989c69 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:20:13.140585 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-c926d777-0428-491c-94a2-2bc5fd989c69 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] [instance: 90cacc35-5115-4b8c-b108-eff10fd63c6f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:20:13.147194 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c926d777-0428-491c-94a2-2bc5fd989c69 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:13.147641 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c926d777-0428-491c-94a2-2bc5fd989c69 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:13.148416 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c926d777-0428-491c-94a2-2bc5fd989c69 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:13.148852 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c926d777-0428-491c-94a2-2bc5fd989c69 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:13.276128 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-c926d777-0428-491c-94a2-2bc5fd989c69 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bfec4b3f8b47cf93f7d07703365d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325c78a0c8574ce0bb38f768705a1181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:20:13.288715 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-c926d777-0428-491c-94a2-2bc5fd989c69 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /compute/v2.1/servers/90cacc35-5115-4b8c-b108-eff10fd63c6f" status: 200 len: 1319 microversion: 2.1 time: 0.153064 Dec 14 03:20:13.289412 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 409/785] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:20:13 2021] GET /compute/v2.1/servers/90cacc35-5115-4b8c-b108-eff10fd63c6f => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:20:13.705389 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-184b7858-dbd8-472f-8927-bf3530ff84f3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:20:13.706121 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-184b7858-dbd8-472f-8927-bf3530ff84f3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:20:13.713226 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-184b7858-dbd8-472f-8927-bf3530ff84f3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:13.713704 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-184b7858-dbd8-472f-8927-bf3530ff84f3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:13.714495 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-184b7858-dbd8-472f-8927-bf3530ff84f3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:13.714937 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-184b7858-dbd8-472f-8927-bf3530ff84f3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:13.843092 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-184b7858-dbd8-472f-8927-bf3530ff84f3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:20:13.852069 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-184b7858-dbd8-472f-8927-bf3530ff84f3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:20:13.853577 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-184b7858-dbd8-472f-8927-bf3530ff84f3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:20:13.854740 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-184b7858-dbd8-472f-8927-bf3530ff84f3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1808 microversion: 2.20 time: 0.153724 Dec 14 03:20:13.855324 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 377/786] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:20:13 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:20:14.005305 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-f3e380af-0486-4b2c-a654-44ae77583346 tempest-VolumesNegativeTest-1016681102 tempest-VolumesNegativeTest-1016681102-project] Action: 'create', calling method: .version_select at 0x7fa5035943a0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1703314064", "metadata": {"Type": "work"}}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:20:14.006845 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-f3e380af-0486-4b2c-a654-44ae77583346 tempest-VolumesNegativeTest-1016681102 tempest-VolumesNegativeTest-1016681102-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=116072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 03:20:14.007704 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-f3e380af-0486-4b2c-a654-44ae77583346 tempest-VolumesNegativeTest-1016681102 tempest-VolumesNegativeTest-1016681102-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.112047 Dec 14 03:20:14.008275 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 410/787] 10.222.0.43 () {60 vars in 1155 bytes} [Tue Dec 14 03:20:13 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 113 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 14 03:20:14.017287 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-9a93a2e2-264a-46e9-a46d-6f59cefe22ab tempest-VolumesNegativeTest-1016681102 tempest-VolumesNegativeTest-1016681102-project] Action: 'create', calling method: .version_select at 0x7fa5036ce310>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1480250335", "metadata": {"Type": "work"}}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:20:14.019358 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-9a93a2e2-264a-46e9-a46d-6f59cefe22ab tempest-VolumesNegativeTest-1016681102 tempest-VolumesNegativeTest-1016681102-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=116071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 03:20:14.020343 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-9a93a2e2-264a-46e9-a46d-6f59cefe22ab tempest-VolumesNegativeTest-1016681102 tempest-VolumesNegativeTest-1016681102-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.006478 Dec 14 03:20:14.020851 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 378/788] 10.222.0.43 () {60 vars in 1155 bytes} [Tue Dec 14 03:20:14 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 14 03:20:14.028573 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-93e1c781-fb10-4990-b6c5-aaef08f6be75 tempest-VolumesNegativeTest-1016681102 tempest-VolumesNegativeTest-1016681102-project] Action: 'create', calling method: .version_select at 0x7fa5035b4790>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-507471647", "metadata": {"Type": "work"}}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:20:14.029711 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-93e1c781-fb10-4990-b6c5-aaef08f6be75 tempest-VolumesNegativeTest-1016681102 tempest-VolumesNegativeTest-1016681102-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=116072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 03:20:14.030482 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-93e1c781-fb10-4990-b6c5-aaef08f6be75 tempest-VolumesNegativeTest-1016681102 tempest-VolumesNegativeTest-1016681102-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.005249 Dec 14 03:20:14.030976 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 411/789] 10.222.0.43 () {60 vars in 1155 bytes} [Tue Dec 14 03:20:14 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 6 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 14 03:20:14.039001 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-9b86fb9c-e31c-4162-868f-ba0cc47c550c tempest-VolumesNegativeTest-1016681102 tempest-VolumesNegativeTest-1016681102-project] Calling method '.version_select at 0x7fa5036e0a60>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:20:14.064626 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.wsgi [None req-9b86fb9c-e31c-4162-868f-ba0cc47c550c tempest-VolumesNegativeTest-1016681102 tempest-VolumesNegativeTest-1016681102-project] HTTP exception thrown: Volume tempest-invalid-1841670127 could not be found. Dec 14 03:20:14.065200 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-9b86fb9c-e31c-4162-868f-ba0cc47c550c tempest-VolumesNegativeTest-1016681102 tempest-VolumesNegativeTest-1016681102-project] Returning 404 to user: Volume tempest-invalid-1841670127 could not be found. {{(pid=116071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 03:20:14.065995 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-9b86fb9c-e31c-4162-868f-ba0cc47c550c tempest-VolumesNegativeTest-1016681102 tempest-VolumesNegativeTest-1016681102-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1841670127" status: 404 len: 99 microversion: 2.1 time: 0.030288 Dec 14 03:20:14.066528 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 379/790] 10.222.0.43 () {58 vars in 1217 bytes} [Tue Dec 14 03:20:14 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-1841670127 => generated 99 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 14 03:20:14.075973 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-39489f43-8cfd-48a6-b6b1-fdf91fd55e1d tempest-VolumesNegativeTest-1016681102 tempest-VolumesNegativeTest-1016681102-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003493 Dec 14 03:20:14.076474 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 412/791] 10.222.0.43 () {58 vars in 1139 bytes} [Tue Dec 14 03:20:14 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Dec 14 03:20:14.085508 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-b7bfdaaf-f172-40cd-884b-0071a58d2b1f tempest-VolumesNegativeTest-1016681102 tempest-VolumesNegativeTest-1016681102-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003345 Dec 14 03:20:14.085987 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 380/792] 10.222.0.43 () {58 vars in 1136 bytes} [Tue Dec 14 03:20:14 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Dec 14 03:20:14.093424 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-9699f0ce-403a-497b-b9b8-1446a6f01f0f tempest-VolumesNegativeTest-1016681102 tempest-VolumesNegativeTest-1016681102-project] Calling method '.version_select at 0x7fa5035b45e0>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:20:14.120377 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.wsgi [None req-9699f0ce-403a-497b-b9b8-1446a6f01f0f tempest-VolumesNegativeTest-1016681102 tempest-VolumesNegativeTest-1016681102-project] HTTP exception thrown: Volume 2e7c2030-fc46-484d-8df1-ee1daf39f6e0 could not be found. Dec 14 03:20:14.120967 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-9699f0ce-403a-497b-b9b8-1446a6f01f0f tempest-VolumesNegativeTest-1016681102 tempest-VolumesNegativeTest-1016681102-project] Returning 404 to user: Volume 2e7c2030-fc46-484d-8df1-ee1daf39f6e0 could not be found. {{(pid=116072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 03:20:14.121779 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-9699f0ce-403a-497b-b9b8-1446a6f01f0f tempest-VolumesNegativeTest-1016681102 tempest-VolumesNegativeTest-1016681102-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/2e7c2030-fc46-484d-8df1-ee1daf39f6e0" status: 404 len: 109 microversion: 2.1 time: 0.031539 Dec 14 03:20:14.122299 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 413/793] 10.222.0.43 () {58 vars in 1247 bytes} [Tue Dec 14 03:20:14 2021] DELETE /compute/v2.1/os-volumes/2e7c2030-fc46-484d-8df1-ee1daf39f6e0 => generated 109 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 14 03:20:14.131374 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-f81a9191-5521-4655-83b3-0c22ed056180 tempest-VolumesNegativeTest-1016681102 tempest-VolumesNegativeTest-1016681102-project] Calling method '.version_select at 0x7fa5080144c0>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:20:14.156505 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.wsgi [None req-f81a9191-5521-4655-83b3-0c22ed056180 tempest-VolumesNegativeTest-1016681102 tempest-VolumesNegativeTest-1016681102-project] HTTP exception thrown: Volume 034939a5-abad-4b05-aaae-8c6b1530b9f4 could not be found. Dec 14 03:20:14.157092 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-f81a9191-5521-4655-83b3-0c22ed056180 tempest-VolumesNegativeTest-1016681102 tempest-VolumesNegativeTest-1016681102-project] Returning 404 to user: Volume 034939a5-abad-4b05-aaae-8c6b1530b9f4 could not be found. {{(pid=116071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 03:20:14.157903 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-f81a9191-5521-4655-83b3-0c22ed056180 tempest-VolumesNegativeTest-1016681102 tempest-VolumesNegativeTest-1016681102-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/034939a5-abad-4b05-aaae-8c6b1530b9f4" status: 404 len: 109 microversion: 2.1 time: 0.030716 Dec 14 03:20:14.158418 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 381/794] 10.222.0.43 () {58 vars in 1244 bytes} [Tue Dec 14 03:20:14 2021] GET /compute/v2.1/os-volumes/034939a5-abad-4b05-aaae-8c6b1530b9f4 => generated 109 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 14 03:20:14.306605 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-9d989e7d-cc7c-4c73-b3cc-c748d5788ff4 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:20:14.307371 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-9d989e7d-cc7c-4c73-b3cc-c748d5788ff4 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] [instance: 90cacc35-5115-4b8c-b108-eff10fd63c6f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:20:14.313678 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9d989e7d-cc7c-4c73-b3cc-c748d5788ff4 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:14.314123 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9d989e7d-cc7c-4c73-b3cc-c748d5788ff4 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:14.314901 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9d989e7d-cc7c-4c73-b3cc-c748d5788ff4 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:14.315348 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9d989e7d-cc7c-4c73-b3cc-c748d5788ff4 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:14.449417 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-9d989e7d-cc7c-4c73-b3cc-c748d5788ff4 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bfec4b3f8b47cf93f7d07703365d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325c78a0c8574ce0bb38f768705a1181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:20:14.458042 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-9d989e7d-cc7c-4c73-b3cc-c748d5788ff4 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /compute/v2.1/servers/90cacc35-5115-4b8c-b108-eff10fd63c6f" status: 200 len: 1319 microversion: 2.1 time: 0.155568 Dec 14 03:20:14.458597 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 414/795] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:20:14 2021] GET /compute/v2.1/servers/90cacc35-5115-4b8c-b108-eff10fd63c6f => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:20:14.873921 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-641c07cb-c816-4958-8eb2-9da05be7f53a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:20:14.874536 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-641c07cb-c816-4958-8eb2-9da05be7f53a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:20:14.881148 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-641c07cb-c816-4958-8eb2-9da05be7f53a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:14.881605 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-641c07cb-c816-4958-8eb2-9da05be7f53a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:14.882396 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-641c07cb-c816-4958-8eb2-9da05be7f53a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:14.882837 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-641c07cb-c816-4958-8eb2-9da05be7f53a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:15.023947 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-641c07cb-c816-4958-8eb2-9da05be7f53a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:20:15.033091 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-641c07cb-c816-4958-8eb2-9da05be7f53a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:20:15.034725 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-641c07cb-c816-4958-8eb2-9da05be7f53a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:20:15.035922 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-641c07cb-c816-4958-8eb2-9da05be7f53a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1808 microversion: 2.20 time: 0.166241 Dec 14 03:20:15.036472 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 382/796] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:20:14 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:20:15.475368 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-9aeeb4a2-1446-4486-bea2-70fce43795ff tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:20:15.476644 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-9aeeb4a2-1446-4486-bea2-70fce43795ff tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] [instance: 90cacc35-5115-4b8c-b108-eff10fd63c6f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:20:15.482932 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9aeeb4a2-1446-4486-bea2-70fce43795ff tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:15.483422 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9aeeb4a2-1446-4486-bea2-70fce43795ff tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:15.484214 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9aeeb4a2-1446-4486-bea2-70fce43795ff tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:15.484650 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9aeeb4a2-1446-4486-bea2-70fce43795ff tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:15.626619 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-9aeeb4a2-1446-4486-bea2-70fce43795ff tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bfec4b3f8b47cf93f7d07703365d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325c78a0c8574ce0bb38f768705a1181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:20:15.634704 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-9aeeb4a2-1446-4486-bea2-70fce43795ff tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /compute/v2.1/servers/90cacc35-5115-4b8c-b108-eff10fd63c6f" status: 200 len: 1319 microversion: 2.1 time: 0.163487 Dec 14 03:20:15.635304 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 415/797] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:20:15 2021] GET /compute/v2.1/servers/90cacc35-5115-4b8c-b108-eff10fd63c6f => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:20:16.053750 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-bebff7d6-f3b6-4cbf-9e79-5b1538bf45e5 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:20:16.054436 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-bebff7d6-f3b6-4cbf-9e79-5b1538bf45e5 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:20:16.060917 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-bebff7d6-f3b6-4cbf-9e79-5b1538bf45e5 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:16.061408 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-bebff7d6-f3b6-4cbf-9e79-5b1538bf45e5 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:16.062189 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-bebff7d6-f3b6-4cbf-9e79-5b1538bf45e5 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:16.062624 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-bebff7d6-f3b6-4cbf-9e79-5b1538bf45e5 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:16.202882 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-bebff7d6-f3b6-4cbf-9e79-5b1538bf45e5 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:20:16.214148 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-bebff7d6-f3b6-4cbf-9e79-5b1538bf45e5 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:20:16.216147 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-bebff7d6-f3b6-4cbf-9e79-5b1538bf45e5 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:20:16.217484 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-bebff7d6-f3b6-4cbf-9e79-5b1538bf45e5 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1795 microversion: 2.20 time: 0.167816 Dec 14 03:20:16.218204 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 383/798] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:20:16 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1795 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:20:16.652228 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-58b4f052-cc9c-4a27-bcbe-b207674845c9 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:20:16.652844 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-58b4f052-cc9c-4a27-bcbe-b207674845c9 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] [instance: 90cacc35-5115-4b8c-b108-eff10fd63c6f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:20:16.659194 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-58b4f052-cc9c-4a27-bcbe-b207674845c9 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:16.659646 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-58b4f052-cc9c-4a27-bcbe-b207674845c9 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:16.660810 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-58b4f052-cc9c-4a27-bcbe-b207674845c9 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:16.660911 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-58b4f052-cc9c-4a27-bcbe-b207674845c9 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:16.789405 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-58b4f052-cc9c-4a27-bcbe-b207674845c9 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bfec4b3f8b47cf93f7d07703365d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325c78a0c8574ce0bb38f768705a1181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:20:16.796507 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-58b4f052-cc9c-4a27-bcbe-b207674845c9 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /compute/v2.1/servers/90cacc35-5115-4b8c-b108-eff10fd63c6f" status: 200 len: 1319 microversion: 2.1 time: 0.147935 Dec 14 03:20:16.797060 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 416/799] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:20:16 2021] GET /compute/v2.1/servers/90cacc35-5115-4b8c-b108-eff10fd63c6f => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:20:17.813137 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-af36ae45-c271-4170-b87a-1726a9e4930b tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:20:17.813754 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-af36ae45-c271-4170-b87a-1726a9e4930b tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] [instance: 90cacc35-5115-4b8c-b108-eff10fd63c6f] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:20:17.820213 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-af36ae45-c271-4170-b87a-1726a9e4930b tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:17.820686 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-af36ae45-c271-4170-b87a-1726a9e4930b tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:17.821462 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-af36ae45-c271-4170-b87a-1726a9e4930b tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:17.821899 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-af36ae45-c271-4170-b87a-1726a9e4930b tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:17.950322 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-af36ae45-c271-4170-b87a-1726a9e4930b tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bfec4b3f8b47cf93f7d07703365d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325c78a0c8574ce0bb38f768705a1181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:20:17.958069 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-af36ae45-c271-4170-b87a-1726a9e4930b tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /compute/v2.1/servers/90cacc35-5115-4b8c-b108-eff10fd63c6f" status: 200 len: 1319 microversion: 2.1 time: 0.148591 Dec 14 03:20:17.958629 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 384/800] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:20:17 2021] GET /compute/v2.1/servers/90cacc35-5115-4b8c-b108-eff10fd63c6f => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:20:18.275420 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [req-a605ae7c-4596-463e-9f4e-f8accaf6a18a req-c6216340-20b7-4490-a6ed-a3041ae9d1e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90cacc35-5115-4b8c-b108-eff10fd63c6f", "name": "network-vif-plugged", "status": "completed", "tag": "dfeb9ef9-1191-4547-92d0-4cdb5a44f9eb"}]} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:20:18.276982 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:20:18.276982 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: warnings.warn(msg) Dec 14 03:20:18.284225 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-a605ae7c-4596-463e-9f4e-f8accaf6a18a req-c6216340-20b7-4490-a6ed-a3041ae9d1e6 service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:18.284686 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-a605ae7c-4596-463e-9f4e-f8accaf6a18a req-c6216340-20b7-4490-a6ed-a3041ae9d1e6 service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:18.295877 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.compute.server_external_events [req-a605ae7c-4596-463e-9f4e-f8accaf6a18a req-c6216340-20b7-4490-a6ed-a3041ae9d1e6 service nova] Creating event network-vif-plugged:dfeb9ef9-1191-4547-92d0-4cdb5a44f9eb for instance 90cacc35-5115-4b8c-b108-eff10fd63c6f on hv-cinder-81803 Dec 14 03:20:18.301298 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [req-a605ae7c-4596-463e-9f4e-f8accaf6a18a req-c6216340-20b7-4490-a6ed-a3041ae9d1e6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029433 Dec 14 03:20:18.301885 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 417/801] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Dec 14 03:20:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:20:18.974723 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-0c6ebe31-940f-440a-a3c1-c4f020101262 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:20:18.975373 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-0c6ebe31-940f-440a-a3c1-c4f020101262 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] [instance: 90cacc35-5115-4b8c-b108-eff10fd63c6f] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:20:18.981590 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-0c6ebe31-940f-440a-a3c1-c4f020101262 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:18.981986 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-0c6ebe31-940f-440a-a3c1-c4f020101262 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:18.982769 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-0c6ebe31-940f-440a-a3c1-c4f020101262 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:18.983242 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-0c6ebe31-940f-440a-a3c1-c4f020101262 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:19.120110 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-0c6ebe31-940f-440a-a3c1-c4f020101262 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bfec4b3f8b47cf93f7d07703365d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325c78a0c8574ce0bb38f768705a1181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:20:19.127437 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-0c6ebe31-940f-440a-a3c1-c4f020101262 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /compute/v2.1/servers/90cacc35-5115-4b8c-b108-eff10fd63c6f" status: 200 len: 1319 microversion: 2.1 time: 0.156292 Dec 14 03:20:19.128573 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 385/802] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:20:18 2021] GET /compute/v2.1/servers/90cacc35-5115-4b8c-b108-eff10fd63c6f => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:20:19.353637 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-619dd284-d386-43b5-92db-d9b3af9415a5 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:20:19.354650 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-619dd284-d386-43b5-92db-d9b3af9415a5 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] [instance: cfd2456c-8f28-4be0-9c97-8e03b0fec041] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:20:19.360679 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-619dd284-d386-43b5-92db-d9b3af9415a5 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:19.361133 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-619dd284-d386-43b5-92db-d9b3af9415a5 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:19.361914 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-619dd284-d386-43b5-92db-d9b3af9415a5 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:19.362365 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-619dd284-d386-43b5-92db-d9b3af9415a5 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:19.429428 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-619dd284-d386-43b5-92db-d9b3af9415a5 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "POST /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041/action" status: 202 len: 0 microversion: 2.1 time: 0.080085 Dec 14 03:20:19.432464 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 418/803] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:20:19 2021] POST /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:20:19.437881 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-184e1689-ff6b-44e7-a13a-dd23ccd0a30c tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:20:19.438502 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-184e1689-ff6b-44e7-a13a-dd23ccd0a30c tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] [instance: cfd2456c-8f28-4be0-9c97-8e03b0fec041] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:20:19.445068 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-184e1689-ff6b-44e7-a13a-dd23ccd0a30c tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:19.445518 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-184e1689-ff6b-44e7-a13a-dd23ccd0a30c tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:19.446343 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-184e1689-ff6b-44e7-a13a-dd23ccd0a30c tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:19.446979 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-184e1689-ff6b-44e7-a13a-dd23ccd0a30c tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:19.589519 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-184e1689-ff6b-44e7-a13a-dd23ccd0a30c tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d620fa9da54f588f753b3c497f00c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:20:19.598090 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-184e1689-ff6b-44e7-a13a-dd23ccd0a30c tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041" status: 200 len: 1752 microversion: 2.1 time: 0.163849 Dec 14 03:20:19.598745 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 386/804] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:20:19 2021] GET /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041 => generated 1752 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:20:20.145260 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-a5e152bd-c809-4c96-a82e-37d560d28f92 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:20:20.145958 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-a5e152bd-c809-4c96-a82e-37d560d28f92 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] [instance: 90cacc35-5115-4b8c-b108-eff10fd63c6f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:20:20.152253 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a5e152bd-c809-4c96-a82e-37d560d28f92 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:20.152713 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a5e152bd-c809-4c96-a82e-37d560d28f92 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:20.153553 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a5e152bd-c809-4c96-a82e-37d560d28f92 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:20.153991 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a5e152bd-c809-4c96-a82e-37d560d28f92 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:20.291070 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-a5e152bd-c809-4c96-a82e-37d560d28f92 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bfec4b3f8b47cf93f7d07703365d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325c78a0c8574ce0bb38f768705a1181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:20:20.298225 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-a5e152bd-c809-4c96-a82e-37d560d28f92 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /compute/v2.1/servers/90cacc35-5115-4b8c-b108-eff10fd63c6f" status: 200 len: 1319 microversion: 2.1 time: 0.156988 Dec 14 03:20:20.298777 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 419/805] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:20:20 2021] GET /compute/v2.1/servers/90cacc35-5115-4b8c-b108-eff10fd63c6f => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:20:20.616644 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-91a8d3aa-e024-46c7-be04-d29cee9970f6 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:20:20.617258 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-91a8d3aa-e024-46c7-be04-d29cee9970f6 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] [instance: cfd2456c-8f28-4be0-9c97-8e03b0fec041] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:20:20.623510 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-91a8d3aa-e024-46c7-be04-d29cee9970f6 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:20.623967 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-91a8d3aa-e024-46c7-be04-d29cee9970f6 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:20.624746 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-91a8d3aa-e024-46c7-be04-d29cee9970f6 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:20.625217 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-91a8d3aa-e024-46c7-be04-d29cee9970f6 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:20.765820 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-91a8d3aa-e024-46c7-be04-d29cee9970f6 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d620fa9da54f588f753b3c497f00c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:20:20.773385 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-91a8d3aa-e024-46c7-be04-d29cee9970f6 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041" status: 200 len: 1752 microversion: 2.1 time: 0.160674 Dec 14 03:20:20.773941 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 387/806] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:20:20 2021] GET /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041 => generated 1752 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:20:21.315426 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-0469acfa-311e-49d4-9518-52ba86daca6f tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:20:21.316078 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-0469acfa-311e-49d4-9518-52ba86daca6f tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] [instance: 90cacc35-5115-4b8c-b108-eff10fd63c6f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:20:21.321897 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0469acfa-311e-49d4-9518-52ba86daca6f tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:21.322337 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0469acfa-311e-49d4-9518-52ba86daca6f tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:21.323124 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0469acfa-311e-49d4-9518-52ba86daca6f tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:21.323556 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0469acfa-311e-49d4-9518-52ba86daca6f tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:21.451420 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-0469acfa-311e-49d4-9518-52ba86daca6f tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bfec4b3f8b47cf93f7d07703365d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325c78a0c8574ce0bb38f768705a1181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:20:21.459513 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-0469acfa-311e-49d4-9518-52ba86daca6f tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /compute/v2.1/servers/90cacc35-5115-4b8c-b108-eff10fd63c6f" status: 200 len: 1319 microversion: 2.1 time: 0.147861 Dec 14 03:20:21.460082 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 420/807] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:20:21 2021] GET /compute/v2.1/servers/90cacc35-5115-4b8c-b108-eff10fd63c6f => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:20:21.789962 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-f5040412-1cad-4bce-8476-e680dd4961df tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:20:21.790578 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-f5040412-1cad-4bce-8476-e680dd4961df tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] [instance: cfd2456c-8f28-4be0-9c97-8e03b0fec041] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:20:21.796780 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-f5040412-1cad-4bce-8476-e680dd4961df tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:21.797236 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-f5040412-1cad-4bce-8476-e680dd4961df tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:21.798015 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-f5040412-1cad-4bce-8476-e680dd4961df tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:21.798457 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-f5040412-1cad-4bce-8476-e680dd4961df tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:21.941216 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-f5040412-1cad-4bce-8476-e680dd4961df tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d620fa9da54f588f753b3c497f00c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:20:21.948956 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-f5040412-1cad-4bce-8476-e680dd4961df tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041" status: 200 len: 1752 microversion: 2.1 time: 0.162668 Dec 14 03:20:21.949510 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 388/808] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:20:21 2021] GET /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041 => generated 1752 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:20:22.476017 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-67ad0c09-fb0d-43ac-8ca2-f7d830b5d4c7 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:20:22.480450 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-67ad0c09-fb0d-43ac-8ca2-f7d830b5d4c7 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] [instance: 90cacc35-5115-4b8c-b108-eff10fd63c6f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:20:22.486882 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-67ad0c09-fb0d-43ac-8ca2-f7d830b5d4c7 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:22.487394 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-67ad0c09-fb0d-43ac-8ca2-f7d830b5d4c7 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:22.488449 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-67ad0c09-fb0d-43ac-8ca2-f7d830b5d4c7 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:22.488886 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-67ad0c09-fb0d-43ac-8ca2-f7d830b5d4c7 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:22.614028 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-67ad0c09-fb0d-43ac-8ca2-f7d830b5d4c7 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bfec4b3f8b47cf93f7d07703365d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325c78a0c8574ce0bb38f768705a1181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:20:22.621469 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-67ad0c09-fb0d-43ac-8ca2-f7d830b5d4c7 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /compute/v2.1/servers/90cacc35-5115-4b8c-b108-eff10fd63c6f" status: 200 len: 1319 microversion: 2.1 time: 0.149026 Dec 14 03:20:22.622032 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 421/809] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:20:22 2021] GET /compute/v2.1/servers/90cacc35-5115-4b8c-b108-eff10fd63c6f => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:20:22.897741 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 14 03:20:22.898068 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: Tue Dec 14 03:20:22 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 14 03:20:22.965442 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-3d0975f0-f617-45cf-937a-b22ce381048c tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:20:22.966059 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-3d0975f0-f617-45cf-937a-b22ce381048c tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] [instance: cfd2456c-8f28-4be0-9c97-8e03b0fec041] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:20:22.972230 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-3d0975f0-f617-45cf-937a-b22ce381048c tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:22.972687 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-3d0975f0-f617-45cf-937a-b22ce381048c tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:22.973471 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-3d0975f0-f617-45cf-937a-b22ce381048c tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:22.973917 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-3d0975f0-f617-45cf-937a-b22ce381048c tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:23.119298 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-3d0975f0-f617-45cf-937a-b22ce381048c tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d620fa9da54f588f753b3c497f00c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:20:23.126939 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-3d0975f0-f617-45cf-937a-b22ce381048c tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041" status: 200 len: 1752 microversion: 2.1 time: 0.165157 Dec 14 03:20:23.127624 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 389/810] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:20:22 2021] GET /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041 => generated 1752 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:20:23.640769 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-024810b2-f24d-4ce5-9bc4-cea42cdff36f tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:20:23.641901 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-024810b2-f24d-4ce5-9bc4-cea42cdff36f tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] [instance: 90cacc35-5115-4b8c-b108-eff10fd63c6f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:20:23.649709 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-024810b2-f24d-4ce5-9bc4-cea42cdff36f tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:23.650474 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-024810b2-f24d-4ce5-9bc4-cea42cdff36f tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:23.651906 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-024810b2-f24d-4ce5-9bc4-cea42cdff36f tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:23.652690 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-024810b2-f24d-4ce5-9bc4-cea42cdff36f tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:23.788415 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-024810b2-f24d-4ce5-9bc4-cea42cdff36f tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bfec4b3f8b47cf93f7d07703365d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325c78a0c8574ce0bb38f768705a1181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:20:23.795518 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-024810b2-f24d-4ce5-9bc4-cea42cdff36f tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /compute/v2.1/servers/90cacc35-5115-4b8c-b108-eff10fd63c6f" status: 200 len: 1319 microversion: 2.1 time: 0.161387 Dec 14 03:20:23.796068 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 422/811] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:20:23 2021] GET /compute/v2.1/servers/90cacc35-5115-4b8c-b108-eff10fd63c6f => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:20:24.143759 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-00094744-b40b-469e-bebe-8209340395e0 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:20:24.144418 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-00094744-b40b-469e-bebe-8209340395e0 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] [instance: cfd2456c-8f28-4be0-9c97-8e03b0fec041] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:20:24.150583 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-00094744-b40b-469e-bebe-8209340395e0 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:24.151034 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-00094744-b40b-469e-bebe-8209340395e0 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:24.151849 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-00094744-b40b-469e-bebe-8209340395e0 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:24.152287 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-00094744-b40b-469e-bebe-8209340395e0 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:24.290340 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-00094744-b40b-469e-bebe-8209340395e0 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d620fa9da54f588f753b3c497f00c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:20:24.298029 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-00094744-b40b-469e-bebe-8209340395e0 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041" status: 200 len: 1757 microversion: 2.1 time: 0.157954 Dec 14 03:20:24.298607 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 390/812] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:20:24 2021] GET /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041 => generated 1757 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:20:24.812409 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-d1f2eb67-1d30-46d6-b283-21da91ae924a tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:20:24.813017 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-d1f2eb67-1d30-46d6-b283-21da91ae924a tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] [instance: 90cacc35-5115-4b8c-b108-eff10fd63c6f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:20:24.819241 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d1f2eb67-1d30-46d6-b283-21da91ae924a tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:24.819704 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d1f2eb67-1d30-46d6-b283-21da91ae924a tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:24.820494 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d1f2eb67-1d30-46d6-b283-21da91ae924a tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:24.820935 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d1f2eb67-1d30-46d6-b283-21da91ae924a tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:24.956031 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-d1f2eb67-1d30-46d6-b283-21da91ae924a tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bfec4b3f8b47cf93f7d07703365d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325c78a0c8574ce0bb38f768705a1181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:20:24.963257 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-d1f2eb67-1d30-46d6-b283-21da91ae924a tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /compute/v2.1/servers/90cacc35-5115-4b8c-b108-eff10fd63c6f" status: 200 len: 1508 microversion: 2.1 time: 0.154373 Dec 14 03:20:24.963748 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 423/813] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:20:24 2021] GET /compute/v2.1/servers/90cacc35-5115-4b8c-b108-eff10fd63c6f => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:20:25.321681 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-69e86e10-e575-424e-aea3-fc25a1e81084 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:20:25.322332 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-69e86e10-e575-424e-aea3-fc25a1e81084 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] [instance: cfd2456c-8f28-4be0-9c97-8e03b0fec041] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:20:25.328659 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-69e86e10-e575-424e-aea3-fc25a1e81084 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:25.329112 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-69e86e10-e575-424e-aea3-fc25a1e81084 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:25.329895 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-69e86e10-e575-424e-aea3-fc25a1e81084 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:25.330337 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-69e86e10-e575-424e-aea3-fc25a1e81084 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:25.476755 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-69e86e10-e575-424e-aea3-fc25a1e81084 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d620fa9da54f588f753b3c497f00c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:20:25.484631 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-69e86e10-e575-424e-aea3-fc25a1e81084 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041" status: 200 len: 1757 microversion: 2.1 time: 0.167137 Dec 14 03:20:25.485189 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 391/814] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:20:25 2021] GET /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041 => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:20:26.501564 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-c184cb3b-527f-44ec-adab-d5cd1eec6a8e tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:20:26.502288 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-c184cb3b-527f-44ec-adab-d5cd1eec6a8e tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] [instance: cfd2456c-8f28-4be0-9c97-8e03b0fec041] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:20:26.508530 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c184cb3b-527f-44ec-adab-d5cd1eec6a8e tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:26.508991 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c184cb3b-527f-44ec-adab-d5cd1eec6a8e tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:26.509779 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c184cb3b-527f-44ec-adab-d5cd1eec6a8e tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:26.510225 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c184cb3b-527f-44ec-adab-d5cd1eec6a8e tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:26.656251 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-c184cb3b-527f-44ec-adab-d5cd1eec6a8e tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d620fa9da54f588f753b3c497f00c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:20:26.664986 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-c184cb3b-527f-44ec-adab-d5cd1eec6a8e tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041" status: 200 len: 1757 microversion: 2.1 time: 0.166983 Dec 14 03:20:26.665566 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 424/815] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:20:26 2021] GET /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041 => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:20:27.682452 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-f6bf212f-4cf4-4b08-aef6-1e11832b185f tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:20:27.683102 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-f6bf212f-4cf4-4b08-aef6-1e11832b185f tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] [instance: cfd2456c-8f28-4be0-9c97-8e03b0fec041] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:20:27.689638 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-f6bf212f-4cf4-4b08-aef6-1e11832b185f tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:27.690159 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-f6bf212f-4cf4-4b08-aef6-1e11832b185f tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:27.690889 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-f6bf212f-4cf4-4b08-aef6-1e11832b185f tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:27.691354 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-f6bf212f-4cf4-4b08-aef6-1e11832b185f tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:27.895821 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-f6bf212f-4cf4-4b08-aef6-1e11832b185f tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d620fa9da54f588f753b3c497f00c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:20:27.903522 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-f6bf212f-4cf4-4b08-aef6-1e11832b185f tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041" status: 200 len: 1757 microversion: 2.1 time: 0.224803 Dec 14 03:20:27.904102 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 392/816] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:20:27 2021] GET /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041 => generated 1757 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:20:28.920901 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-491ff9da-6ff7-44b4-8174-038af9d21aee tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:20:28.921459 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-491ff9da-6ff7-44b4-8174-038af9d21aee tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] [instance: cfd2456c-8f28-4be0-9c97-8e03b0fec041] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:20:28.927393 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-491ff9da-6ff7-44b4-8174-038af9d21aee tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:28.927852 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-491ff9da-6ff7-44b4-8174-038af9d21aee tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:28.928638 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-491ff9da-6ff7-44b4-8174-038af9d21aee tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:28.929097 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-491ff9da-6ff7-44b4-8174-038af9d21aee tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:29.077629 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-491ff9da-6ff7-44b4-8174-038af9d21aee tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d620fa9da54f588f753b3c497f00c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:20:29.086227 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-491ff9da-6ff7-44b4-8174-038af9d21aee tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041" status: 200 len: 1757 microversion: 2.1 time: 0.168896 Dec 14 03:20:29.086796 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 425/817] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:20:28 2021] GET /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041 => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:20:30.103852 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-a177aa07-5e60-4bb3-b7ab-af04200f3778 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:20:30.104462 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-a177aa07-5e60-4bb3-b7ab-af04200f3778 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] [instance: cfd2456c-8f28-4be0-9c97-8e03b0fec041] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:20:30.111161 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a177aa07-5e60-4bb3-b7ab-af04200f3778 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:30.111732 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a177aa07-5e60-4bb3-b7ab-af04200f3778 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:30.112532 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a177aa07-5e60-4bb3-b7ab-af04200f3778 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:30.113243 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a177aa07-5e60-4bb3-b7ab-af04200f3778 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:30.265451 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-a177aa07-5e60-4bb3-b7ab-af04200f3778 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d620fa9da54f588f753b3c497f00c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:20:30.273843 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-a177aa07-5e60-4bb3-b7ab-af04200f3778 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041" status: 200 len: 1757 microversion: 2.1 time: 0.174451 Dec 14 03:20:30.274421 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 393/818] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:20:30 2021] GET /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041 => generated 1757 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 03:20:31.290159 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-1514e30f-a110-45e5-b372-ae7b9dc38873 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:20:31.290701 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-1514e30f-a110-45e5-b372-ae7b9dc38873 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] [instance: cfd2456c-8f28-4be0-9c97-8e03b0fec041] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:20:31.296881 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1514e30f-a110-45e5-b372-ae7b9dc38873 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:31.297324 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1514e30f-a110-45e5-b372-ae7b9dc38873 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:31.298094 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1514e30f-a110-45e5-b372-ae7b9dc38873 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:31.298527 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1514e30f-a110-45e5-b372-ae7b9dc38873 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:31.440312 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-1514e30f-a110-45e5-b372-ae7b9dc38873 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d620fa9da54f588f753b3c497f00c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:20:31.448658 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-1514e30f-a110-45e5-b372-ae7b9dc38873 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041" status: 200 len: 1757 microversion: 2.1 time: 0.162184 Dec 14 03:20:31.449211 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 426/819] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:20:31 2021] GET /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041 => generated 1757 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:20:32.465230 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-660b457d-5f7c-43a1-82b7-7a2c88da540a tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:20:32.465851 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-660b457d-5f7c-43a1-82b7-7a2c88da540a tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] [instance: cfd2456c-8f28-4be0-9c97-8e03b0fec041] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:20:32.472862 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-660b457d-5f7c-43a1-82b7-7a2c88da540a tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:32.473324 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-660b457d-5f7c-43a1-82b7-7a2c88da540a tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:32.474159 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-660b457d-5f7c-43a1-82b7-7a2c88da540a tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:32.474600 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-660b457d-5f7c-43a1-82b7-7a2c88da540a tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:32.624857 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-660b457d-5f7c-43a1-82b7-7a2c88da540a tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d620fa9da54f588f753b3c497f00c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:20:32.633160 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-660b457d-5f7c-43a1-82b7-7a2c88da540a tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041" status: 200 len: 1757 microversion: 2.1 time: 0.171593 Dec 14 03:20:32.633721 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 394/820] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:20:32 2021] GET /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041 => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:20:33.649252 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-7fd1b4ed-2c1b-4f82-bd4d-a704345e7494 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:20:33.649922 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-7fd1b4ed-2c1b-4f82-bd4d-a704345e7494 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] [instance: cfd2456c-8f28-4be0-9c97-8e03b0fec041] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:20:33.656281 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7fd1b4ed-2c1b-4f82-bd4d-a704345e7494 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:33.656778 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7fd1b4ed-2c1b-4f82-bd4d-a704345e7494 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:33.657565 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7fd1b4ed-2c1b-4f82-bd4d-a704345e7494 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:33.658010 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7fd1b4ed-2c1b-4f82-bd4d-a704345e7494 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:33.802182 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-7fd1b4ed-2c1b-4f82-bd4d-a704345e7494 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d620fa9da54f588f753b3c497f00c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:20:33.810540 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-7fd1b4ed-2c1b-4f82-bd4d-a704345e7494 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041" status: 200 len: 1757 microversion: 2.1 time: 0.165045 Dec 14 03:20:33.811124 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 427/821] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:20:33 2021] GET /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041 => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:20:34.828062 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-845a9d63-6f38-4055-8071-c75e81031c96 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:20:34.829329 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-845a9d63-6f38-4055-8071-c75e81031c96 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] [instance: cfd2456c-8f28-4be0-9c97-8e03b0fec041] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:20:34.837042 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-845a9d63-6f38-4055-8071-c75e81031c96 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:34.837638 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-845a9d63-6f38-4055-8071-c75e81031c96 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:34.838700 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-845a9d63-6f38-4055-8071-c75e81031c96 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:34.839207 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-845a9d63-6f38-4055-8071-c75e81031c96 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:34.996006 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-845a9d63-6f38-4055-8071-c75e81031c96 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d620fa9da54f588f753b3c497f00c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:20:35.003832 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-845a9d63-6f38-4055-8071-c75e81031c96 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041" status: 200 len: 1757 microversion: 2.1 time: 0.179668 Dec 14 03:20:35.004395 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 395/822] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:20:34 2021] GET /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041 => generated 1757 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:20:36.021204 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-e738d150-2665-4e21-a1bf-edfc2f1d050d tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:20:36.021773 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-e738d150-2665-4e21-a1bf-edfc2f1d050d tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] [instance: cfd2456c-8f28-4be0-9c97-8e03b0fec041] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:20:36.028066 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e738d150-2665-4e21-a1bf-edfc2f1d050d tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:36.028517 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e738d150-2665-4e21-a1bf-edfc2f1d050d tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:36.029293 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e738d150-2665-4e21-a1bf-edfc2f1d050d tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:36.029730 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e738d150-2665-4e21-a1bf-edfc2f1d050d tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:36.169567 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-e738d150-2665-4e21-a1bf-edfc2f1d050d tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d620fa9da54f588f753b3c497f00c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:20:36.177226 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-e738d150-2665-4e21-a1bf-edfc2f1d050d tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041" status: 200 len: 1757 microversion: 2.1 time: 0.159823 Dec 14 03:20:36.177786 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 428/823] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:20:36 2021] GET /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041 => generated 1757 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:20:37.193819 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-0718daca-51ef-418c-a852-90800cbdaf55 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:20:37.194987 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-0718daca-51ef-418c-a852-90800cbdaf55 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] [instance: cfd2456c-8f28-4be0-9c97-8e03b0fec041] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:20:37.203671 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-0718daca-51ef-418c-a852-90800cbdaf55 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:37.204131 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-0718daca-51ef-418c-a852-90800cbdaf55 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:37.204933 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-0718daca-51ef-418c-a852-90800cbdaf55 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:37.205376 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-0718daca-51ef-418c-a852-90800cbdaf55 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:37.419027 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-0718daca-51ef-418c-a852-90800cbdaf55 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d620fa9da54f588f753b3c497f00c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:20:37.428278 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-0718daca-51ef-418c-a852-90800cbdaf55 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041" status: 200 len: 1757 microversion: 2.1 time: 0.238255 Dec 14 03:20:37.429703 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 396/824] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:20:37 2021] GET /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041 => generated 1757 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:20:38.445742 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-348df0e0-1da3-4c49-9a44-a3a6151aa5e3 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:20:38.446353 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-348df0e0-1da3-4c49-9a44-a3a6151aa5e3 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] [instance: cfd2456c-8f28-4be0-9c97-8e03b0fec041] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:20:38.452708 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-348df0e0-1da3-4c49-9a44-a3a6151aa5e3 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:38.453152 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-348df0e0-1da3-4c49-9a44-a3a6151aa5e3 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:38.453922 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-348df0e0-1da3-4c49-9a44-a3a6151aa5e3 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:38.454591 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-348df0e0-1da3-4c49-9a44-a3a6151aa5e3 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:38.610828 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-348df0e0-1da3-4c49-9a44-a3a6151aa5e3 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d620fa9da54f588f753b3c497f00c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:20:38.629084 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-348df0e0-1da3-4c49-9a44-a3a6151aa5e3 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041" status: 200 len: 1757 microversion: 2.1 time: 0.186914 Dec 14 03:20:38.629672 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 429/825] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:20:38 2021] GET /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041 => generated 1757 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:20:38.926213 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-492614a4-d072-4101-9038-88a8e93a18d8 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:20:38.926721 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-492614a4-d072-4101-9038-88a8e93a18d8 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:20:38.932564 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-492614a4-d072-4101-9038-88a8e93a18d8 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:38.933015 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-492614a4-d072-4101-9038-88a8e93a18d8 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:38.934002 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-492614a4-d072-4101-9038-88a8e93a18d8 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:38.934450 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-492614a4-d072-4101-9038-88a8e93a18d8 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:39.022786 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.objects.instance [None req-492614a4-d072-4101-9038-88a8e93a18d8 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lazy-loading 'services' on Instance uuid fd35b83c-0304-43fc-85ec-731c395d3364 {{(pid=116071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 14 03:20:39.096212 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-492614a4-d072-4101-9038-88a8e93a18d8 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "DELETE /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/os-volume_attachments/1a480dac-a351-4833-98cd-285d4f080698" status: 202 len: 0 microversion: 2.1 time: 0.400031 Dec 14 03:20:39.096810 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 397/826] 10.222.0.43 () {58 vars in 1415 bytes} [Tue Dec 14 03:20:38 2021] DELETE /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/os-volume_attachments/1a480dac-a351-4833-98cd-285d4f080698 => generated 0 bytes in 402 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:20:39.645270 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-631d4ec0-f7de-4801-928f-ecfbd92a0b48 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:20:39.645895 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-631d4ec0-f7de-4801-928f-ecfbd92a0b48 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] [instance: cfd2456c-8f28-4be0-9c97-8e03b0fec041] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:20:39.652725 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-631d4ec0-f7de-4801-928f-ecfbd92a0b48 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:39.653290 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-631d4ec0-f7de-4801-928f-ecfbd92a0b48 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:39.654073 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-631d4ec0-f7de-4801-928f-ecfbd92a0b48 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:39.654515 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-631d4ec0-f7de-4801-928f-ecfbd92a0b48 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:39.818793 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-631d4ec0-f7de-4801-928f-ecfbd92a0b48 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d620fa9da54f588f753b3c497f00c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:20:39.827990 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-631d4ec0-f7de-4801-928f-ecfbd92a0b48 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041" status: 200 len: 1757 microversion: 2.1 time: 0.186320 Dec 14 03:20:39.828638 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 430/827] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:20:39 2021] GET /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041 => generated 1757 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:20:40.847344 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-792e8f25-079d-4d71-9163-cf18086229be tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:20:40.848045 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-792e8f25-079d-4d71-9163-cf18086229be tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] [instance: cfd2456c-8f28-4be0-9c97-8e03b0fec041] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:20:40.855254 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-792e8f25-079d-4d71-9163-cf18086229be tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:40.855701 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-792e8f25-079d-4d71-9163-cf18086229be tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:40.856472 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-792e8f25-079d-4d71-9163-cf18086229be tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:40.856902 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-792e8f25-079d-4d71-9163-cf18086229be tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:40.999421 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-792e8f25-079d-4d71-9163-cf18086229be tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d620fa9da54f588f753b3c497f00c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:20:41.007785 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-792e8f25-079d-4d71-9163-cf18086229be tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041" status: 200 len: 1760 microversion: 2.1 time: 0.164846 Dec 14 03:20:41.008343 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 398/828] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:20:40 2021] GET /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041 => generated 1760 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:20:41.264653 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-0e91fe00-3ea5-470c-876d-3e53a7612e22 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:20:41.270971 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0e91fe00-3ea5-470c-876d-3e53a7612e22 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:41.271464 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0e91fe00-3ea5-470c-876d-3e53a7612e22 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:41.448367 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-0e91fe00-3ea5-470c-876d-3e53a7612e22 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Going to try to stop instance {{(pid=116072) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Dec 14 03:20:41.488956 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-0e91fe00-3ea5-470c-876d-3e53a7612e22 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action" status: 202 len: 0 microversion: 2.1 time: 0.227474 Dec 14 03:20:41.489467 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 431/829] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:20:41 2021] POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:20:41.497912 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-d2ae335b-2d07-4020-a084-45bf99ecf4a6 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:20:41.498537 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-d2ae335b-2d07-4020-a084-45bf99ecf4a6 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:20:41.504416 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-d2ae335b-2d07-4020-a084-45bf99ecf4a6 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:41.504880 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-d2ae335b-2d07-4020-a084-45bf99ecf4a6 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:41.505672 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-d2ae335b-2d07-4020-a084-45bf99ecf4a6 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:41.506629 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-d2ae335b-2d07-4020-a084-45bf99ecf4a6 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:41.632526 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-d2ae335b-2d07-4020-a084-45bf99ecf4a6 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107444106cda461dab7c403665d92613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:20:41.640007 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-d2ae335b-2d07-4020-a084-45bf99ecf4a6 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364" status: 200 len: 1676 microversion: 2.1 time: 0.145765 Dec 14 03:20:41.640592 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 399/830] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:20:41 2021] GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364 => generated 1676 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 03:20:42.663758 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-aadd82f7-1a83-452d-ac54-c6f16bc13639 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:20:42.664497 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-aadd82f7-1a83-452d-ac54-c6f16bc13639 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:20:42.671022 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-aadd82f7-1a83-452d-ac54-c6f16bc13639 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:42.671508 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-aadd82f7-1a83-452d-ac54-c6f16bc13639 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:42.672280 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-aadd82f7-1a83-452d-ac54-c6f16bc13639 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:42.672712 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-aadd82f7-1a83-452d-ac54-c6f16bc13639 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:42.812700 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-aadd82f7-1a83-452d-ac54-c6f16bc13639 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107444106cda461dab7c403665d92613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:20:42.820980 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-aadd82f7-1a83-452d-ac54-c6f16bc13639 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364" status: 200 len: 1676 microversion: 2.1 time: 0.161901 Dec 14 03:20:42.821849 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 432/831] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:20:42 2021] GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364 => generated 1676 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:20:43.838488 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-71a260ba-276e-427e-b9c3-460daf2eea49 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:20:43.839188 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-71a260ba-276e-427e-b9c3-460daf2eea49 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:20:43.845401 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-71a260ba-276e-427e-b9c3-460daf2eea49 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:43.845846 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-71a260ba-276e-427e-b9c3-460daf2eea49 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:43.846615 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-71a260ba-276e-427e-b9c3-460daf2eea49 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:43.847068 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-71a260ba-276e-427e-b9c3-460daf2eea49 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:43.973829 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-71a260ba-276e-427e-b9c3-460daf2eea49 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107444106cda461dab7c403665d92613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:20:43.981045 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-71a260ba-276e-427e-b9c3-460daf2eea49 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364" status: 200 len: 1676 microversion: 2.1 time: 0.146730 Dec 14 03:20:43.981606 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 400/832] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:20:43 2021] GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364 => generated 1676 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:20:44.997603 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-45a533be-402f-4226-90d8-9096a61bedd8 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:20:44.998327 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-45a533be-402f-4226-90d8-9096a61bedd8 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:20:45.004806 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-45a533be-402f-4226-90d8-9096a61bedd8 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:45.005368 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-45a533be-402f-4226-90d8-9096a61bedd8 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:45.006219 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-45a533be-402f-4226-90d8-9096a61bedd8 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:45.006702 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-45a533be-402f-4226-90d8-9096a61bedd8 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:45.140372 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-45a533be-402f-4226-90d8-9096a61bedd8 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107444106cda461dab7c403665d92613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:20:45.148142 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-45a533be-402f-4226-90d8-9096a61bedd8 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364" status: 200 len: 1676 microversion: 2.1 time: 0.154220 Dec 14 03:20:45.148703 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 433/833] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:20:44 2021] GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364 => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:20:46.165378 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-bf9f86e3-a285-494b-84cc-5c95acff64f8 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:20:46.165914 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-bf9f86e3-a285-494b-84cc-5c95acff64f8 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:20:46.172140 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-bf9f86e3-a285-494b-84cc-5c95acff64f8 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:46.172592 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-bf9f86e3-a285-494b-84cc-5c95acff64f8 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:46.173367 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-bf9f86e3-a285-494b-84cc-5c95acff64f8 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:46.173805 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-bf9f86e3-a285-494b-84cc-5c95acff64f8 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:46.298557 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-bf9f86e3-a285-494b-84cc-5c95acff64f8 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107444106cda461dab7c403665d92613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:20:46.305730 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-bf9f86e3-a285-494b-84cc-5c95acff64f8 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364" status: 200 len: 1676 microversion: 2.1 time: 0.144567 Dec 14 03:20:46.306296 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 401/834] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:20:46 2021] GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364 => generated 1676 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:20:47.322669 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-9c78c1ab-dcc9-45c0-a49a-3b6542c6b5d5 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:20:47.323315 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-9c78c1ab-dcc9-45c0-a49a-3b6542c6b5d5 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:20:47.329804 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9c78c1ab-dcc9-45c0-a49a-3b6542c6b5d5 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:47.330220 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9c78c1ab-dcc9-45c0-a49a-3b6542c6b5d5 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:47.330990 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9c78c1ab-dcc9-45c0-a49a-3b6542c6b5d5 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:47.331515 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9c78c1ab-dcc9-45c0-a49a-3b6542c6b5d5 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:47.458839 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-9c78c1ab-dcc9-45c0-a49a-3b6542c6b5d5 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107444106cda461dab7c403665d92613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:20:47.466854 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-9c78c1ab-dcc9-45c0-a49a-3b6542c6b5d5 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364" status: 200 len: 1676 microversion: 2.1 time: 0.148345 Dec 14 03:20:47.467463 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 434/835] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:20:47 2021] GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364 => generated 1676 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:20:48.483769 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-c242b721-c658-4a27-85a9-1d3ec6d9f0a2 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:20:48.484458 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-c242b721-c658-4a27-85a9-1d3ec6d9f0a2 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:20:48.491472 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c242b721-c658-4a27-85a9-1d3ec6d9f0a2 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:48.491928 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c242b721-c658-4a27-85a9-1d3ec6d9f0a2 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:48.492722 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c242b721-c658-4a27-85a9-1d3ec6d9f0a2 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:48.493171 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c242b721-c658-4a27-85a9-1d3ec6d9f0a2 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:48.626228 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-c242b721-c658-4a27-85a9-1d3ec6d9f0a2 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107444106cda461dab7c403665d92613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:20:48.634090 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-c242b721-c658-4a27-85a9-1d3ec6d9f0a2 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364" status: 200 len: 1676 microversion: 2.1 time: 0.154009 Dec 14 03:20:48.634757 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 402/836] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:20:48 2021] GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364 => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:20:49.651545 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-d5030e31-a212-438b-9a8b-2f72f77f92ca tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:20:49.652265 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-d5030e31-a212-438b-9a8b-2f72f77f92ca tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:20:49.658705 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d5030e31-a212-438b-9a8b-2f72f77f92ca tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:49.659186 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d5030e31-a212-438b-9a8b-2f72f77f92ca tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:49.659968 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d5030e31-a212-438b-9a8b-2f72f77f92ca tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:49.671564 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d5030e31-a212-438b-9a8b-2f72f77f92ca tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:49.806372 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-d5030e31-a212-438b-9a8b-2f72f77f92ca tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107444106cda461dab7c403665d92613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:20:49.814548 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-d5030e31-a212-438b-9a8b-2f72f77f92ca tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364" status: 200 len: 1676 microversion: 2.1 time: 0.166565 Dec 14 03:20:49.815130 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 435/837] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:20:49 2021] GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364 => generated 1676 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:20:50.831915 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-25833ba8-578d-4395-8ccb-2ca43e4f62fb tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:20:50.832527 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-25833ba8-578d-4395-8ccb-2ca43e4f62fb tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:20:50.839331 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-25833ba8-578d-4395-8ccb-2ca43e4f62fb tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:50.839783 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-25833ba8-578d-4395-8ccb-2ca43e4f62fb tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:50.840566 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-25833ba8-578d-4395-8ccb-2ca43e4f62fb tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:50.841011 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-25833ba8-578d-4395-8ccb-2ca43e4f62fb tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:50.968299 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-25833ba8-578d-4395-8ccb-2ca43e4f62fb tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107444106cda461dab7c403665d92613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:20:50.976258 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-25833ba8-578d-4395-8ccb-2ca43e4f62fb tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364" status: 200 len: 1676 microversion: 2.1 time: 0.147363 Dec 14 03:20:50.976816 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 403/838] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:20:50 2021] GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364 => generated 1676 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:20:51.993859 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-beab278f-5f9f-41a0-a404-78ef1047f235 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:20:51.994465 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-beab278f-5f9f-41a0-a404-78ef1047f235 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:20:52.000385 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-beab278f-5f9f-41a0-a404-78ef1047f235 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:52.000829 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-beab278f-5f9f-41a0-a404-78ef1047f235 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:52.001593 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-beab278f-5f9f-41a0-a404-78ef1047f235 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:52.002023 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-beab278f-5f9f-41a0-a404-78ef1047f235 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:52.127981 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-beab278f-5f9f-41a0-a404-78ef1047f235 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107444106cda461dab7c403665d92613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:20:52.135122 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-beab278f-5f9f-41a0-a404-78ef1047f235 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364" status: 200 len: 1676 microversion: 2.1 time: 0.145558 Dec 14 03:20:52.135735 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 436/839] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:20:51 2021] GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364 => generated 1676 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:20:53.151301 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-f1059e87-c0ea-4c72-9806-43c6707a1119 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:20:53.151909 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-f1059e87-c0ea-4c72-9806-43c6707a1119 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:20:53.158062 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-f1059e87-c0ea-4c72-9806-43c6707a1119 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:53.158514 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-f1059e87-c0ea-4c72-9806-43c6707a1119 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:53.159309 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-f1059e87-c0ea-4c72-9806-43c6707a1119 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:53.159745 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-f1059e87-c0ea-4c72-9806-43c6707a1119 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:53.286902 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-f1059e87-c0ea-4c72-9806-43c6707a1119 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107444106cda461dab7c403665d92613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:20:53.294711 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-f1059e87-c0ea-4c72-9806-43c6707a1119 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364" status: 200 len: 1676 microversion: 2.1 time: 0.147000 Dec 14 03:20:53.295294 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 404/840] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:20:53 2021] GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364 => generated 1676 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:20:53.660031 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-3f06396e-f7a9-480d-a1d0-cda373ea9c54 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "401d67b6-8491-4572-ab45-7ac16eccd187", "device": "/dev/sdb"}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:20:53.661643 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-3f06396e-f7a9-480d-a1d0-cda373ea9c54 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] [instance: 90cacc35-5115-4b8c-b108-eff10fd63c6f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:20:53.668553 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3f06396e-f7a9-480d-a1d0-cda373ea9c54 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:53.669033 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3f06396e-f7a9-480d-a1d0-cda373ea9c54 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:53.669818 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3f06396e-f7a9-480d-a1d0-cda373ea9c54 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:53.670256 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3f06396e-f7a9-480d-a1d0-cda373ea9c54 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:53.914864 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-3f06396e-f7a9-480d-a1d0-cda373ea9c54 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "POST /compute/v2.1/servers/90cacc35-5115-4b8c-b108-eff10fd63c6f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.258151 Dec 14 03:20:53.915527 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 437/841] 10.222.0.43 () {60 vars in 1322 bytes} [Tue Dec 14 03:20:53 2021] POST /compute/v2.1/servers/90cacc35-5115-4b8c-b108-eff10fd63c6f/os-volume_attachments => generated 194 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 14 03:20:54.312065 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-f641b7b7-0e1f-4735-bb31-558cd77ff9ce tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:20:54.312716 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-f641b7b7-0e1f-4735-bb31-558cd77ff9ce tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:20:54.319325 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-f641b7b7-0e1f-4735-bb31-558cd77ff9ce tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:54.319730 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-f641b7b7-0e1f-4735-bb31-558cd77ff9ce tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:54.320508 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-f641b7b7-0e1f-4735-bb31-558cd77ff9ce tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:54.320943 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-f641b7b7-0e1f-4735-bb31-558cd77ff9ce tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:54.448013 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-f641b7b7-0e1f-4735-bb31-558cd77ff9ce tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107444106cda461dab7c403665d92613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:20:54.455550 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-f641b7b7-0e1f-4735-bb31-558cd77ff9ce tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364" status: 200 len: 1676 microversion: 2.1 time: 0.147120 Dec 14 03:20:54.456157 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 405/842] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:20:54 2021] GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364 => generated 1676 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:20:55.472785 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-b7763f0a-86f4-45cd-ab9e-e91b702537e2 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:20:55.473487 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-b7763f0a-86f4-45cd-ab9e-e91b702537e2 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:20:55.479541 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b7763f0a-86f4-45cd-ab9e-e91b702537e2 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:55.479997 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b7763f0a-86f4-45cd-ab9e-e91b702537e2 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:55.480772 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b7763f0a-86f4-45cd-ab9e-e91b702537e2 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:55.481211 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b7763f0a-86f4-45cd-ab9e-e91b702537e2 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:55.608432 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-b7763f0a-86f4-45cd-ab9e-e91b702537e2 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107444106cda461dab7c403665d92613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:20:55.615828 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-b7763f0a-86f4-45cd-ab9e-e91b702537e2 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364" status: 200 len: 1676 microversion: 2.1 time: 0.147502 Dec 14 03:20:55.616920 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 438/843] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:20:55 2021] GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364 => generated 1676 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:20:56.633016 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-3fcd25e2-5fd3-412d-abe9-4c3d2f563eff tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:20:56.633623 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-3fcd25e2-5fd3-412d-abe9-4c3d2f563eff tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:20:56.640052 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-3fcd25e2-5fd3-412d-abe9-4c3d2f563eff tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:56.640516 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-3fcd25e2-5fd3-412d-abe9-4c3d2f563eff tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:56.641304 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-3fcd25e2-5fd3-412d-abe9-4c3d2f563eff tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:56.641748 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-3fcd25e2-5fd3-412d-abe9-4c3d2f563eff tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:56.769487 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-3fcd25e2-5fd3-412d-abe9-4c3d2f563eff tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107444106cda461dab7c403665d92613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:20:56.777167 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-3fcd25e2-5fd3-412d-abe9-4c3d2f563eff tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364" status: 200 len: 1676 microversion: 2.1 time: 0.147757 Dec 14 03:20:56.777730 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 406/844] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:20:56 2021] GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364 => generated 1676 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:20:57.794354 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-b94bf2fd-f4a7-472d-ab08-4896478f0565 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:20:57.794995 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-b94bf2fd-f4a7-472d-ab08-4896478f0565 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:20:57.801290 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b94bf2fd-f4a7-472d-ab08-4896478f0565 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:57.801740 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b94bf2fd-f4a7-472d-ab08-4896478f0565 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:57.802514 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b94bf2fd-f4a7-472d-ab08-4896478f0565 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:57.802948 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b94bf2fd-f4a7-472d-ab08-4896478f0565 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:57.928921 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-b94bf2fd-f4a7-472d-ab08-4896478f0565 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107444106cda461dab7c403665d92613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:20:57.936081 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-b94bf2fd-f4a7-472d-ab08-4896478f0565 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364" status: 200 len: 1676 microversion: 2.1 time: 0.145364 Dec 14 03:20:57.936634 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 439/845] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:20:57 2021] GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364 => generated 1676 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:20:58.953387 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-d57a0f7e-2eb5-4cd7-9c82-6ead7ab82170 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:20:58.954003 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-d57a0f7e-2eb5-4cd7-9c82-6ead7ab82170 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:20:58.959919 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-d57a0f7e-2eb5-4cd7-9c82-6ead7ab82170 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:58.960367 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-d57a0f7e-2eb5-4cd7-9c82-6ead7ab82170 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:58.961141 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-d57a0f7e-2eb5-4cd7-9c82-6ead7ab82170 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:20:58.961577 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-d57a0f7e-2eb5-4cd7-9c82-6ead7ab82170 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:20:59.101710 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-d57a0f7e-2eb5-4cd7-9c82-6ead7ab82170 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107444106cda461dab7c403665d92613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:20:59.108942 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-d57a0f7e-2eb5-4cd7-9c82-6ead7ab82170 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364" status: 200 len: 1676 microversion: 2.1 time: 0.159242 Dec 14 03:20:59.109499 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 407/846] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:20:58 2021] GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364 => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:21:00.126486 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-0c7d0343-6671-4943-ac8d-821d0ed3eb8b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:21:00.127153 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-0c7d0343-6671-4943-ac8d-821d0ed3eb8b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:21:00.133520 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0c7d0343-6671-4943-ac8d-821d0ed3eb8b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:21:00.133973 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0c7d0343-6671-4943-ac8d-821d0ed3eb8b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:21:00.134767 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0c7d0343-6671-4943-ac8d-821d0ed3eb8b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:21:00.135224 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0c7d0343-6671-4943-ac8d-821d0ed3eb8b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:21:00.268857 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-0c7d0343-6671-4943-ac8d-821d0ed3eb8b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107444106cda461dab7c403665d92613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:21:00.276136 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-0c7d0343-6671-4943-ac8d-821d0ed3eb8b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364" status: 200 len: 1676 microversion: 2.1 time: 0.153318 Dec 14 03:21:00.276685 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 440/847] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:21:00 2021] GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364 => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:21:01.292702 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-bd00dd71-840e-4e13-822f-847b5e44af19 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:21:01.293309 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-bd00dd71-840e-4e13-822f-847b5e44af19 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:21:01.299425 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-bd00dd71-840e-4e13-822f-847b5e44af19 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:21:01.299873 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-bd00dd71-840e-4e13-822f-847b5e44af19 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:21:01.300649 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-bd00dd71-840e-4e13-822f-847b5e44af19 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:21:01.301090 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-bd00dd71-840e-4e13-822f-847b5e44af19 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:21:01.431635 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-bd00dd71-840e-4e13-822f-847b5e44af19 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107444106cda461dab7c403665d92613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:21:01.439446 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-bd00dd71-840e-4e13-822f-847b5e44af19 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364" status: 200 len: 1676 microversion: 2.1 time: 0.150284 Dec 14 03:21:01.440018 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 408/848] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:21:01 2021] GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364 => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:21:02.457287 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-ae08b8dd-a09e-4fee-8a3f-38856ddad821 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:21:02.457915 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-ae08b8dd-a09e-4fee-8a3f-38856ddad821 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:21:02.464163 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ae08b8dd-a09e-4fee-8a3f-38856ddad821 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:21:02.464614 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ae08b8dd-a09e-4fee-8a3f-38856ddad821 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:21:02.465420 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ae08b8dd-a09e-4fee-8a3f-38856ddad821 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:21:02.465856 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ae08b8dd-a09e-4fee-8a3f-38856ddad821 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:21:02.592945 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-ae08b8dd-a09e-4fee-8a3f-38856ddad821 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107444106cda461dab7c403665d92613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:21:02.600680 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-ae08b8dd-a09e-4fee-8a3f-38856ddad821 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364" status: 200 len: 1653 microversion: 2.1 time: 0.146550 Dec 14 03:21:02.601264 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 441/849] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:21:02 2021] GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364 => generated 1653 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:21:02.617355 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-2abc6785-d023-425e-9af1-7c616f30189b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:21:02.623563 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-2abc6785-d023-425e-9af1-7c616f30189b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:21:02.624017 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-2abc6785-d023-425e-9af1-7c616f30189b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:21:02.682296 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-2abc6785-d023-425e-9af1-7c616f30189b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Going to try to start instance {{(pid=116071) start /opt/stack/nova/nova/compute/api.py:2677}} Dec 14 03:21:02.724131 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-2abc6785-d023-425e-9af1-7c616f30189b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action" status: 202 len: 0 microversion: 2.1 time: 0.110940 Dec 14 03:21:02.724635 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 409/850] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:21:02 2021] POST /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:21:02.733369 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-d5ee8471-ab43-4e5c-b136-376ad00c863a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:21:02.733991 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-d5ee8471-ab43-4e5c-b136-376ad00c863a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:21:02.740086 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d5ee8471-ab43-4e5c-b136-376ad00c863a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:21:02.740571 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d5ee8471-ab43-4e5c-b136-376ad00c863a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:21:02.741841 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d5ee8471-ab43-4e5c-b136-376ad00c863a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:21:02.742285 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d5ee8471-ab43-4e5c-b136-376ad00c863a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:21:02.870689 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-d5ee8471-ab43-4e5c-b136-376ad00c863a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107444106cda461dab7c403665d92613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:21:02.878028 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-d5ee8471-ab43-4e5c-b136-376ad00c863a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364" status: 200 len: 1662 microversion: 2.1 time: 0.148367 Dec 14 03:21:02.878588 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 442/851] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:21:02 2021] GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364 => generated 1662 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:21:03.896733 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-bcc1283a-1124-4b1f-97bc-37d761ef8a9f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:21:03.897917 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-bcc1283a-1124-4b1f-97bc-37d761ef8a9f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:21:03.903927 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-bcc1283a-1124-4b1f-97bc-37d761ef8a9f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:21:03.904376 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-bcc1283a-1124-4b1f-97bc-37d761ef8a9f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:21:03.905152 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-bcc1283a-1124-4b1f-97bc-37d761ef8a9f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:21:03.905591 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-bcc1283a-1124-4b1f-97bc-37d761ef8a9f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:21:04.033262 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-bcc1283a-1124-4b1f-97bc-37d761ef8a9f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107444106cda461dab7c403665d92613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:21:04.040447 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-bcc1283a-1124-4b1f-97bc-37d761ef8a9f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364" status: 200 len: 1662 microversion: 2.1 time: 0.148297 Dec 14 03:21:04.041000 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 410/852] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:21:03 2021] GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364 => generated 1662 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:21:05.057378 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-8d28ef78-3530-4d49-b560-4b9fb1bd43eb tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:21:05.057992 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-8d28ef78-3530-4d49-b560-4b9fb1bd43eb tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:21:05.064215 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8d28ef78-3530-4d49-b560-4b9fb1bd43eb tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:21:05.064647 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8d28ef78-3530-4d49-b560-4b9fb1bd43eb tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:21:05.065416 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8d28ef78-3530-4d49-b560-4b9fb1bd43eb tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:21:05.065847 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8d28ef78-3530-4d49-b560-4b9fb1bd43eb tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:21:05.190154 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-8d28ef78-3530-4d49-b560-4b9fb1bd43eb tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107444106cda461dab7c403665d92613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:21:05.197280 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-8d28ef78-3530-4d49-b560-4b9fb1bd43eb tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364" status: 200 len: 1662 microversion: 2.1 time: 0.143518 Dec 14 03:21:05.197826 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 443/853] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:21:05 2021] GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364 => generated 1662 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:21:06.215139 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-79d0affb-e891-4bb0-bb73-dec3e8c62ffd tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:21:06.215759 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-79d0affb-e891-4bb0-bb73-dec3e8c62ffd tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:21:06.221957 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-79d0affb-e891-4bb0-bb73-dec3e8c62ffd tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:21:06.222418 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-79d0affb-e891-4bb0-bb73-dec3e8c62ffd tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:21:06.223232 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-79d0affb-e891-4bb0-bb73-dec3e8c62ffd tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:21:06.223695 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-79d0affb-e891-4bb0-bb73-dec3e8c62ffd tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:21:06.353019 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-79d0affb-e891-4bb0-bb73-dec3e8c62ffd tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107444106cda461dab7c403665d92613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:21:06.360309 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-79d0affb-e891-4bb0-bb73-dec3e8c62ffd tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364" status: 200 len: 1662 microversion: 2.1 time: 0.150108 Dec 14 03:21:06.360877 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 411/854] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:21:06 2021] GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364 => generated 1662 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:21:07.377254 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-1656845e-c71b-47a8-a1c4-6445cc162a18 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:21:07.377878 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-1656845e-c71b-47a8-a1c4-6445cc162a18 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:21:07.384752 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1656845e-c71b-47a8-a1c4-6445cc162a18 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:21:07.385206 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1656845e-c71b-47a8-a1c4-6445cc162a18 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:21:07.385992 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1656845e-c71b-47a8-a1c4-6445cc162a18 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:21:07.386430 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1656845e-c71b-47a8-a1c4-6445cc162a18 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:21:07.511682 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-1656845e-c71b-47a8-a1c4-6445cc162a18 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107444106cda461dab7c403665d92613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:21:07.518820 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-1656845e-c71b-47a8-a1c4-6445cc162a18 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364" status: 200 len: 1666 microversion: 2.1 time: 0.145177 Dec 14 03:21:07.519405 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 444/855] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:21:07 2021] GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364 => generated 1666 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:21:20.495885 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-47902340-ad9a-40b6-aa1e-2cfd637b2b98 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:21:20.496387 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-47902340-ad9a-40b6-aa1e-2cfd637b2b98 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] [instance: 90cacc35-5115-4b8c-b108-eff10fd63c6f] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:21:20.502636 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-47902340-ad9a-40b6-aa1e-2cfd637b2b98 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:21:20.503132 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-47902340-ad9a-40b6-aa1e-2cfd637b2b98 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:21:20.503915 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-47902340-ad9a-40b6-aa1e-2cfd637b2b98 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:21:20.504354 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-47902340-ad9a-40b6-aa1e-2cfd637b2b98 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:21:20.581854 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.objects.instance [None req-47902340-ad9a-40b6-aa1e-2cfd637b2b98 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lazy-loading 'services' on Instance uuid 90cacc35-5115-4b8c-b108-eff10fd63c6f {{(pid=116071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 14 03:21:20.646906 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-47902340-ad9a-40b6-aa1e-2cfd637b2b98 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "DELETE /compute/v2.1/servers/90cacc35-5115-4b8c-b108-eff10fd63c6f/os-volume_attachments/401d67b6-8491-4572-ab45-7ac16eccd187" status: 202 len: 0 microversion: 2.1 time: 0.155288 Dec 14 03:21:20.647524 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 412/856] 10.222.0.43 () {58 vars in 1415 bytes} [Tue Dec 14 03:21:20 2021] DELETE /compute/v2.1/servers/90cacc35-5115-4b8c-b108-eff10fd63c6f/os-volume_attachments/401d67b6-8491-4572-ab45-7ac16eccd187 => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 14 03:21:21.754394 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-9e7914fa-dee9-4517-a62d-4679b04a65a5 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:21:21.754909 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-9e7914fa-dee9-4517-a62d-4679b04a65a5 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] [instance: 90cacc35-5115-4b8c-b108-eff10fd63c6f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:21:21.761227 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9e7914fa-dee9-4517-a62d-4679b04a65a5 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:21:21.761681 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9e7914fa-dee9-4517-a62d-4679b04a65a5 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:21:21.762457 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9e7914fa-dee9-4517-a62d-4679b04a65a5 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:21:21.762897 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9e7914fa-dee9-4517-a62d-4679b04a65a5 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:21:21.786154 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-9e7914fa-dee9-4517-a62d-4679b04a65a5 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] [instance: 90cacc35-5115-4b8c-b108-eff10fd63c6f] Going to try to terminate instance {{(pid=116072) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 14 03:21:21.860075 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-9e7914fa-dee9-4517-a62d-4679b04a65a5 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "DELETE /compute/v2.1/servers/90cacc35-5115-4b8c-b108-eff10fd63c6f" status: 204 len: 0 microversion: 2.1 time: 0.109075 Dec 14 03:21:21.860648 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 445/857] 10.222.0.43 () {58 vars in 1238 bytes} [Tue Dec 14 03:21:21 2021] DELETE /compute/v2.1/servers/90cacc35-5115-4b8c-b108-eff10fd63c6f => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 14 03:21:21.871936 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-d5e1523e-e725-417f-b71e-69f7cdc6c6a8 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:21:21.872653 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-d5e1523e-e725-417f-b71e-69f7cdc6c6a8 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] [instance: 90cacc35-5115-4b8c-b108-eff10fd63c6f] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:21:21.878812 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-d5e1523e-e725-417f-b71e-69f7cdc6c6a8 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:21:21.879319 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-d5e1523e-e725-417f-b71e-69f7cdc6c6a8 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:21:21.880111 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-d5e1523e-e725-417f-b71e-69f7cdc6c6a8 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:21:21.880548 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-d5e1523e-e725-417f-b71e-69f7cdc6c6a8 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:21:22.012525 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-d5e1523e-e725-417f-b71e-69f7cdc6c6a8 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bfec4b3f8b47cf93f7d07703365d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325c78a0c8574ce0bb38f768705a1181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:21:22.019912 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-d5e1523e-e725-417f-b71e-69f7cdc6c6a8 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /compute/v2.1/servers/90cacc35-5115-4b8c-b108-eff10fd63c6f" status: 200 len: 1514 microversion: 2.1 time: 0.154549 Dec 14 03:21:22.020489 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 413/858] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:21:21 2021] GET /compute/v2.1/servers/90cacc35-5115-4b8c-b108-eff10fd63c6f => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:21:23.037470 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-1fda9364-91bb-426f-b34f-67588888b28b tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:21:23.038199 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-1fda9364-91bb-426f-b34f-67588888b28b tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] [instance: 90cacc35-5115-4b8c-b108-eff10fd63c6f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:21:23.044474 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1fda9364-91bb-426f-b34f-67588888b28b tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:21:23.044924 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1fda9364-91bb-426f-b34f-67588888b28b tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:21:23.045699 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1fda9364-91bb-426f-b34f-67588888b28b tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:21:23.046136 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1fda9364-91bb-426f-b34f-67588888b28b tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:21:23.171932 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-1fda9364-91bb-426f-b34f-67588888b28b tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bfec4b3f8b47cf93f7d07703365d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325c78a0c8574ce0bb38f768705a1181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:21:23.179646 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-1fda9364-91bb-426f-b34f-67588888b28b tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /compute/v2.1/servers/90cacc35-5115-4b8c-b108-eff10fd63c6f" status: 200 len: 1514 microversion: 2.1 time: 0.145631 Dec 14 03:21:23.180203 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 446/859] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:21:23 2021] GET /compute/v2.1/servers/90cacc35-5115-4b8c-b108-eff10fd63c6f => generated 1514 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:21:24.196873 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-c5832529-e0e1-4edc-a32d-29463d03f7a1 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:21:24.197486 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-c5832529-e0e1-4edc-a32d-29463d03f7a1 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] [instance: 90cacc35-5115-4b8c-b108-eff10fd63c6f] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:21:24.203835 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c5832529-e0e1-4edc-a32d-29463d03f7a1 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:21:24.204284 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c5832529-e0e1-4edc-a32d-29463d03f7a1 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:21:24.205056 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c5832529-e0e1-4edc-a32d-29463d03f7a1 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:21:24.205492 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c5832529-e0e1-4edc-a32d-29463d03f7a1 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:21:24.331941 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-c5832529-e0e1-4edc-a32d-29463d03f7a1 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bfec4b3f8b47cf93f7d07703365d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325c78a0c8574ce0bb38f768705a1181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:21:24.339755 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-c5832529-e0e1-4edc-a32d-29463d03f7a1 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /compute/v2.1/servers/90cacc35-5115-4b8c-b108-eff10fd63c6f" status: 200 len: 1514 microversion: 2.1 time: 0.147003 Dec 14 03:21:24.340520 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 414/860] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:21:24 2021] GET /compute/v2.1/servers/90cacc35-5115-4b8c-b108-eff10fd63c6f => generated 1514 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:21:24.667888 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [req-519753f4-8126-49bd-815d-8416fe46b1f7 req-ccb54738-3241-48c1-8cb8-357878cbd3e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90cacc35-5115-4b8c-b108-eff10fd63c6f", "name": "network-vif-deleted", "tag": "dfeb9ef9-1191-4547-92d0-4cdb5a44f9eb"}]} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:21:24.670127 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:21:24.670127 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: warnings.warn(msg) Dec 14 03:21:24.677374 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-519753f4-8126-49bd-815d-8416fe46b1f7 req-ccb54738-3241-48c1-8cb8-357878cbd3e7 service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:21:24.677818 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-519753f4-8126-49bd-815d-8416fe46b1f7 req-ccb54738-3241-48c1-8cb8-357878cbd3e7 service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:21:24.689021 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.compute.server_external_events [req-519753f4-8126-49bd-815d-8416fe46b1f7 req-ccb54738-3241-48c1-8cb8-357878cbd3e7 service nova] Creating event network-vif-deleted:dfeb9ef9-1191-4547-92d0-4cdb5a44f9eb for instance 90cacc35-5115-4b8c-b108-eff10fd63c6f on hv-cinder-81803 Dec 14 03:21:24.693775 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [req-519753f4-8126-49bd-815d-8416fe46b1f7 req-ccb54738-3241-48c1-8cb8-357878cbd3e7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029279 Dec 14 03:21:24.694291 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 447/861] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Dec 14 03:21:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:21:25.357019 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-785f7e7a-9e53-4303-9590-e6373e9d6330 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:21:25.357625 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-785f7e7a-9e53-4303-9590-e6373e9d6330 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] [instance: 90cacc35-5115-4b8c-b108-eff10fd63c6f] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:21:25.364239 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-785f7e7a-9e53-4303-9590-e6373e9d6330 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:21:25.364689 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-785f7e7a-9e53-4303-9590-e6373e9d6330 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:21:25.365488 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-785f7e7a-9e53-4303-9590-e6373e9d6330 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:21:25.365921 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-785f7e7a-9e53-4303-9590-e6373e9d6330 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:21:25.378619 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.wsgi [None req-785f7e7a-9e53-4303-9590-e6373e9d6330 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] HTTP exception thrown: Instance 90cacc35-5115-4b8c-b108-eff10fd63c6f could not be found. Dec 14 03:21:25.379236 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-785f7e7a-9e53-4303-9590-e6373e9d6330 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Returning 404 to user: Instance 90cacc35-5115-4b8c-b108-eff10fd63c6f could not be found. {{(pid=116071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 03:21:25.380041 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-785f7e7a-9e53-4303-9590-e6373e9d6330 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /compute/v2.1/servers/90cacc35-5115-4b8c-b108-eff10fd63c6f" status: 404 len: 111 microversion: 2.1 time: 0.026747 Dec 14 03:21:25.380570 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 415/862] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:21:25 2021] GET /compute/v2.1/servers/90cacc35-5115-4b8c-b108-eff10fd63c6f => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 14 03:21:30.906651 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 14 03:21:30.907303 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: Tue Dec 14 03:21:30 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 14 03:21:37.228584 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-0012be24-7bf8-4759-a199-0cdb6fd17256 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2031455258", "imageRef": "4fff76a9-6620-4bda-b1ec-2cd3719c946a", "flavorRef": "452", "networks": [{"uuid": "72a1ba60-29fb-46d5-ae0c-f4c2277490a8"}]}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:21:37.278307 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.network.neutron [None req-0012be24-7bf8-4759-a199-0cdb6fd17256 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] validate_networks() for [('72a1ba60-29fb-46d5-ae0c-f4c2277490a8', None, None, None, None, None)] {{(pid=116072) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 14 03:21:37.824684 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-0012be24-7bf8-4759-a199-0cdb6fd17256 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Flavor limits 0:0:0 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 14 03:21:37.825112 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-0012be24-7bf8-4759-a199-0cdb6fd17256 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Image limits 0:0:0 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 14 03:21:37.825612 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-0012be24-7bf8-4759-a199-0cdb6fd17256 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Flavor pref 0:0:0 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 14 03:21:37.826025 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-0012be24-7bf8-4759-a199-0cdb6fd17256 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Image pref 0:0:0 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 14 03:21:37.826439 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-0012be24-7bf8-4759-a199-0cdb6fd17256 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 14 03:21:37.834953 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0012be24-7bf8-4759-a199-0cdb6fd17256 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:21:37.835445 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0012be24-7bf8-4759-a199-0cdb6fd17256 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:21:37.836776 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0012be24-7bf8-4759-a199-0cdb6fd17256 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:21:37.837214 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0012be24-7bf8-4759-a199-0cdb6fd17256 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:21:37.853587 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.quota [None req-0012be24-7bf8-4759-a199-0cdb6fd17256 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Getting quotas for project 325c78a0c8574ce0bb38f768705a1181. Resources: {'cores', 'instances', 'ram'} {{(pid=116072) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 03:21:37.857465 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.quota [None req-0012be24-7bf8-4759-a199-0cdb6fd17256 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Getting quotas for user e9bfec4b3f8b47cf93f7d07703365d1a and project 325c78a0c8574ce0bb38f768705a1181. Resources: {'cores', 'instances', 'ram'} {{(pid=116072) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 03:21:37.868272 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-0012be24-7bf8-4759-a199-0cdb6fd17256 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Going to run 1 instances... {{(pid=116072) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 14 03:21:37.870679 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-0012be24-7bf8-4759-a199-0cdb6fd17256 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] [instance: 57e0aa27-4adb-426a-9236-0543142651e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4fff76a9-6620-4bda-b1ec-2cd3719c946a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 14 03:21:37.915984 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-0012be24-7bf8-4759-a199-0cdb6fd17256 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.691690 Dec 14 03:21:37.916535 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 448/863] 10.222.0.43 () {60 vars in 1146 bytes} [Tue Dec 14 03:21:37 2021] POST /compute/v2.1/servers => generated 380 bytes in 693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 14 03:21:37.926510 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-3fbc7b71-43a6-4b20-9d15-c0f096174dc1 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:21:37.927174 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-3fbc7b71-43a6-4b20-9d15-c0f096174dc1 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] [instance: 57e0aa27-4adb-426a-9236-0543142651e0] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:21:37.987834 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-3fbc7b71-43a6-4b20-9d15-c0f096174dc1 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bfec4b3f8b47cf93f7d07703365d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325c78a0c8574ce0bb38f768705a1181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:21:37.997958 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-3fbc7b71-43a6-4b20-9d15-c0f096174dc1 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /compute/v2.1/servers/57e0aa27-4adb-426a-9236-0543142651e0" status: 200 len: 1219 microversion: 2.1 time: 0.075149 Dec 14 03:21:37.998739 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 416/864] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:21:37 2021] GET /compute/v2.1/servers/57e0aa27-4adb-426a-9236-0543142651e0 => generated 1219 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 03:21:39.014841 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-8c3dfe20-a60b-4fac-98f3-a07ea841d5d0 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:21:39.015537 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-8c3dfe20-a60b-4fac-98f3-a07ea841d5d0 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] [instance: 57e0aa27-4adb-426a-9236-0543142651e0] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:21:39.023660 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8c3dfe20-a60b-4fac-98f3-a07ea841d5d0 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:21:39.024109 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8c3dfe20-a60b-4fac-98f3-a07ea841d5d0 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:21:39.024904 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8c3dfe20-a60b-4fac-98f3-a07ea841d5d0 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:21:39.025341 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8c3dfe20-a60b-4fac-98f3-a07ea841d5d0 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:21:39.086897 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-8c3dfe20-a60b-4fac-98f3-a07ea841d5d0 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bfec4b3f8b47cf93f7d07703365d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325c78a0c8574ce0bb38f768705a1181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:21:39.094229 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-8c3dfe20-a60b-4fac-98f3-a07ea841d5d0 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /compute/v2.1/servers/57e0aa27-4adb-426a-9236-0543142651e0" status: 200 len: 1277 microversion: 2.1 time: 0.083061 Dec 14 03:21:39.094774 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 449/865] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:21:39 2021] GET /compute/v2.1/servers/57e0aa27-4adb-426a-9236-0543142651e0 => generated 1277 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:21:40.111639 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-ce004442-19b6-44d6-b83a-97a2f8eaef30 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:21:40.112321 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-ce004442-19b6-44d6-b83a-97a2f8eaef30 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] [instance: 57e0aa27-4adb-426a-9236-0543142651e0] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:21:40.120488 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ce004442-19b6-44d6-b83a-97a2f8eaef30 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:21:40.120949 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ce004442-19b6-44d6-b83a-97a2f8eaef30 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:21:40.121735 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ce004442-19b6-44d6-b83a-97a2f8eaef30 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:21:40.122173 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ce004442-19b6-44d6-b83a-97a2f8eaef30 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:21:40.254338 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-ce004442-19b6-44d6-b83a-97a2f8eaef30 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bfec4b3f8b47cf93f7d07703365d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325c78a0c8574ce0bb38f768705a1181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:21:40.262150 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-ce004442-19b6-44d6-b83a-97a2f8eaef30 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /compute/v2.1/servers/57e0aa27-4adb-426a-9236-0543142651e0" status: 200 len: 1319 microversion: 2.1 time: 0.154188 Dec 14 03:21:40.262713 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 417/866] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:21:40 2021] GET /compute/v2.1/servers/57e0aa27-4adb-426a-9236-0543142651e0 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:21:40.418950 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [req-58e1fdbb-271c-466c-8783-c4d42af39c9f req-9845aedd-23a9-4d00-9377-3ba7b6a45ae3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57e0aa27-4adb-426a-9236-0543142651e0", "tag": "0a5dcf35-42a4-4fa6-a151-bf760152d86b"}]} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:21:40.420566 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:21:40.420566 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: warnings.warn(msg) Dec 14 03:21:40.428196 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-58e1fdbb-271c-466c-8783-c4d42af39c9f req-9845aedd-23a9-4d00-9377-3ba7b6a45ae3 service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:21:40.428640 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-58e1fdbb-271c-466c-8783-c4d42af39c9f req-9845aedd-23a9-4d00-9377-3ba7b6a45ae3 service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:21:40.442663 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.compute.server_external_events [req-58e1fdbb-271c-466c-8783-c4d42af39c9f req-9845aedd-23a9-4d00-9377-3ba7b6a45ae3 service nova] Creating event network-changed:0a5dcf35-42a4-4fa6-a151-bf760152d86b for instance 57e0aa27-4adb-426a-9236-0543142651e0 on hv-cinder-81803 Dec 14 03:21:40.448101 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [req-58e1fdbb-271c-466c-8783-c4d42af39c9f req-9845aedd-23a9-4d00-9377-3ba7b6a45ae3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032871 Dec 14 03:21:40.448687 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 450/867] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Dec 14 03:21:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:21:41.279425 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-4cbdfe9e-f01a-48a4-b2d3-7cc281a72493 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:21:41.280042 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-4cbdfe9e-f01a-48a4-b2d3-7cc281a72493 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] [instance: 57e0aa27-4adb-426a-9236-0543142651e0] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:21:41.286345 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-4cbdfe9e-f01a-48a4-b2d3-7cc281a72493 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:21:41.286815 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-4cbdfe9e-f01a-48a4-b2d3-7cc281a72493 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:21:41.287612 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-4cbdfe9e-f01a-48a4-b2d3-7cc281a72493 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:21:41.288055 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-4cbdfe9e-f01a-48a4-b2d3-7cc281a72493 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:21:41.418347 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-4cbdfe9e-f01a-48a4-b2d3-7cc281a72493 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bfec4b3f8b47cf93f7d07703365d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325c78a0c8574ce0bb38f768705a1181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:21:41.425441 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-4cbdfe9e-f01a-48a4-b2d3-7cc281a72493 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /compute/v2.1/servers/57e0aa27-4adb-426a-9236-0543142651e0" status: 200 len: 1319 microversion: 2.1 time: 0.149641 Dec 14 03:21:41.425997 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 418/868] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:21:41 2021] GET /compute/v2.1/servers/57e0aa27-4adb-426a-9236-0543142651e0 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:21:42.441774 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-f81406b5-7001-455a-8118-c84b21aba2a3 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:21:42.442472 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-f81406b5-7001-455a-8118-c84b21aba2a3 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] [instance: 57e0aa27-4adb-426a-9236-0543142651e0] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:21:42.449722 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f81406b5-7001-455a-8118-c84b21aba2a3 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:21:42.450167 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f81406b5-7001-455a-8118-c84b21aba2a3 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:21:42.450961 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f81406b5-7001-455a-8118-c84b21aba2a3 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:21:42.451422 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f81406b5-7001-455a-8118-c84b21aba2a3 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:21:42.579581 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-f81406b5-7001-455a-8118-c84b21aba2a3 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bfec4b3f8b47cf93f7d07703365d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325c78a0c8574ce0bb38f768705a1181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:21:42.587276 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-f81406b5-7001-455a-8118-c84b21aba2a3 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /compute/v2.1/servers/57e0aa27-4adb-426a-9236-0543142651e0" status: 200 len: 1319 microversion: 2.1 time: 0.149436 Dec 14 03:21:42.587824 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 451/869] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:21:42 2021] GET /compute/v2.1/servers/57e0aa27-4adb-426a-9236-0543142651e0 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:21:43.604205 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-865a00bb-a37b-4c81-b5d6-1aad877ba727 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:21:43.604817 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-865a00bb-a37b-4c81-b5d6-1aad877ba727 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] [instance: 57e0aa27-4adb-426a-9236-0543142651e0] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:21:43.611230 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-865a00bb-a37b-4c81-b5d6-1aad877ba727 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:21:43.611850 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-865a00bb-a37b-4c81-b5d6-1aad877ba727 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:21:43.612902 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-865a00bb-a37b-4c81-b5d6-1aad877ba727 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:21:43.613323 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-865a00bb-a37b-4c81-b5d6-1aad877ba727 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:21:43.740892 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-865a00bb-a37b-4c81-b5d6-1aad877ba727 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bfec4b3f8b47cf93f7d07703365d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325c78a0c8574ce0bb38f768705a1181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:21:43.748809 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-865a00bb-a37b-4c81-b5d6-1aad877ba727 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /compute/v2.1/servers/57e0aa27-4adb-426a-9236-0543142651e0" status: 200 len: 1319 microversion: 2.1 time: 0.148767 Dec 14 03:21:43.749368 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 419/870] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:21:43 2021] GET /compute/v2.1/servers/57e0aa27-4adb-426a-9236-0543142651e0 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:21:44.765547 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-cff76226-400a-4698-9633-b84cfcb4397f tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:21:44.766169 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-cff76226-400a-4698-9633-b84cfcb4397f tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] [instance: 57e0aa27-4adb-426a-9236-0543142651e0] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:21:44.772190 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-cff76226-400a-4698-9633-b84cfcb4397f tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:21:44.772647 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-cff76226-400a-4698-9633-b84cfcb4397f tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:21:44.773948 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-cff76226-400a-4698-9633-b84cfcb4397f tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:21:44.774396 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-cff76226-400a-4698-9633-b84cfcb4397f tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:21:44.905159 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-cff76226-400a-4698-9633-b84cfcb4397f tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bfec4b3f8b47cf93f7d07703365d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325c78a0c8574ce0bb38f768705a1181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:21:44.912260 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-cff76226-400a-4698-9633-b84cfcb4397f tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /compute/v2.1/servers/57e0aa27-4adb-426a-9236-0543142651e0" status: 200 len: 1319 microversion: 2.1 time: 0.150455 Dec 14 03:21:44.912822 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 452/871] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:21:44 2021] GET /compute/v2.1/servers/57e0aa27-4adb-426a-9236-0543142651e0 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:21:45.930355 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-a226fba6-122d-48f7-a0c2-ef518799ff4a tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:21:45.930890 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-a226fba6-122d-48f7-a0c2-ef518799ff4a tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] [instance: 57e0aa27-4adb-426a-9236-0543142651e0] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:21:45.937341 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a226fba6-122d-48f7-a0c2-ef518799ff4a tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:21:45.937812 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a226fba6-122d-48f7-a0c2-ef518799ff4a tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:21:45.938605 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a226fba6-122d-48f7-a0c2-ef518799ff4a tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:21:45.939080 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a226fba6-122d-48f7-a0c2-ef518799ff4a tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:21:46.065732 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-a226fba6-122d-48f7-a0c2-ef518799ff4a tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bfec4b3f8b47cf93f7d07703365d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325c78a0c8574ce0bb38f768705a1181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:21:46.073436 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-a226fba6-122d-48f7-a0c2-ef518799ff4a tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /compute/v2.1/servers/57e0aa27-4adb-426a-9236-0543142651e0" status: 200 len: 1319 microversion: 2.1 time: 0.147549 Dec 14 03:21:46.073998 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 420/872] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:21:45 2021] GET /compute/v2.1/servers/57e0aa27-4adb-426a-9236-0543142651e0 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:21:47.090021 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-82061095-ce38-4d51-96fc-04d793c04a3b tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:21:47.090629 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-82061095-ce38-4d51-96fc-04d793c04a3b tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] [instance: 57e0aa27-4adb-426a-9236-0543142651e0] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:21:47.096869 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-82061095-ce38-4d51-96fc-04d793c04a3b tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:21:47.097322 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-82061095-ce38-4d51-96fc-04d793c04a3b tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:21:47.098093 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-82061095-ce38-4d51-96fc-04d793c04a3b tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:21:47.098533 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-82061095-ce38-4d51-96fc-04d793c04a3b tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:21:47.224952 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-82061095-ce38-4d51-96fc-04d793c04a3b tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bfec4b3f8b47cf93f7d07703365d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325c78a0c8574ce0bb38f768705a1181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:21:47.232555 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-82061095-ce38-4d51-96fc-04d793c04a3b tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /compute/v2.1/servers/57e0aa27-4adb-426a-9236-0543142651e0" status: 200 len: 1319 microversion: 2.1 time: 0.146221 Dec 14 03:21:47.233111 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 453/873] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:21:47 2021] GET /compute/v2.1/servers/57e0aa27-4adb-426a-9236-0543142651e0 => generated 1319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:21:47.518303 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-04d7f0f4-545c-4edb-8ca2-4a4edf76f6c7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:21:47.518871 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-04d7f0f4-545c-4edb-8ca2-4a4edf76f6c7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:21:47.525274 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-04d7f0f4-545c-4edb-8ca2-4a4edf76f6c7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:21:47.525730 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-04d7f0f4-545c-4edb-8ca2-4a4edf76f6c7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:21:47.526516 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-04d7f0f4-545c-4edb-8ca2-4a4edf76f6c7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:21:47.526985 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-04d7f0f4-545c-4edb-8ca2-4a4edf76f6c7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:21:47.555560 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-04d7f0f4-545c-4edb-8ca2-4a4edf76f6c7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/os-volume_attachments/25c4a8a1-e445-4c3d-88d2-bf2e05777b27" status: 200 len: 194 microversion: 2.20 time: 0.041110 Dec 14 03:21:47.556122 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 421/874] 10.222.0.43 () {60 vars in 1453 bytes} [Tue Dec 14 03:21:47 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/os-volume_attachments/25c4a8a1-e445-4c3d-88d2-bf2e05777b27 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:21:47.614105 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-ddf1d0e8-af8e-4004-bfdd-83b23f4e5f8d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:21:47.614600 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-ddf1d0e8-af8e-4004-bfdd-83b23f4e5f8d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:21:47.620356 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ddf1d0e8-af8e-4004-bfdd-83b23f4e5f8d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:21:47.620806 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ddf1d0e8-af8e-4004-bfdd-83b23f4e5f8d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:21:47.621577 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ddf1d0e8-af8e-4004-bfdd-83b23f4e5f8d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:21:47.622012 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ddf1d0e8-af8e-4004-bfdd-83b23f4e5f8d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:21:47.697090 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.objects.instance [None req-ddf1d0e8-af8e-4004-bfdd-83b23f4e5f8d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lazy-loading 'services' on Instance uuid 86395107-d320-45d8-83de-f1848858be10 {{(pid=116072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 14 03:21:47.766831 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-ddf1d0e8-af8e-4004-bfdd-83b23f4e5f8d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "DELETE /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/os-volume_attachments/25c4a8a1-e445-4c3d-88d2-bf2e05777b27" status: 202 len: 0 microversion: 2.20 time: 0.156403 Dec 14 03:21:47.767803 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 454/875] 10.222.0.43 () {60 vars in 1456 bytes} [Tue Dec 14 03:21:47 2021] DELETE /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/os-volume_attachments/25c4a8a1-e445-4c3d-88d2-bf2e05777b27 => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 14 03:21:47.777334 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-b3bc1061-0313-415c-8d7d-dc873ba613ee tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:21:47.778458 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-b3bc1061-0313-415c-8d7d-dc873ba613ee tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:21:47.786381 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b3bc1061-0313-415c-8d7d-dc873ba613ee tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:21:47.786846 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b3bc1061-0313-415c-8d7d-dc873ba613ee tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:21:47.787683 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b3bc1061-0313-415c-8d7d-dc873ba613ee tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:21:47.788254 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b3bc1061-0313-415c-8d7d-dc873ba613ee tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:21:47.820937 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-b3bc1061-0313-415c-8d7d-dc873ba613ee tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048615 Dec 14 03:21:47.821509 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 422/876] 10.222.0.43 () {60 vars in 1342 bytes} [Tue Dec 14 03:21:47 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:21:47.904221 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [req-2846447c-ca66-43fc-95ed-27c616a210b6 req-4cb56180-910e-47a4-992d-bf7669428e3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57e0aa27-4adb-426a-9236-0543142651e0", "name": "network-vif-plugged", "status": "completed", "tag": "0a5dcf35-42a4-4fa6-a151-bf760152d86b"}]} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:21:47.905733 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:21:47.905733 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: warnings.warn(msg) Dec 14 03:21:47.914360 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-2846447c-ca66-43fc-95ed-27c616a210b6 req-4cb56180-910e-47a4-992d-bf7669428e3c service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:21:47.914854 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-2846447c-ca66-43fc-95ed-27c616a210b6 req-4cb56180-910e-47a4-992d-bf7669428e3c service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:21:47.926944 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.compute.server_external_events [req-2846447c-ca66-43fc-95ed-27c616a210b6 req-4cb56180-910e-47a4-992d-bf7669428e3c service nova] Creating event network-vif-plugged:0a5dcf35-42a4-4fa6-a151-bf760152d86b for instance 57e0aa27-4adb-426a-9236-0543142651e0 on hv-cinder-81803 Dec 14 03:21:47.931942 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [req-2846447c-ca66-43fc-95ed-27c616a210b6 req-4cb56180-910e-47a4-992d-bf7669428e3c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031661 Dec 14 03:21:47.932705 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 455/877] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Dec 14 03:21:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:21:48.249335 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-11e68707-47c5-4a3f-8854-173eda16db96 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:21:48.249940 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-11e68707-47c5-4a3f-8854-173eda16db96 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] [instance: 57e0aa27-4adb-426a-9236-0543142651e0] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:21:48.255626 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-11e68707-47c5-4a3f-8854-173eda16db96 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:21:48.256075 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-11e68707-47c5-4a3f-8854-173eda16db96 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:21:48.256870 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-11e68707-47c5-4a3f-8854-173eda16db96 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:21:48.257326 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-11e68707-47c5-4a3f-8854-173eda16db96 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:21:48.384894 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-11e68707-47c5-4a3f-8854-173eda16db96 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bfec4b3f8b47cf93f7d07703365d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325c78a0c8574ce0bb38f768705a1181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:21:48.398707 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-11e68707-47c5-4a3f-8854-173eda16db96 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /compute/v2.1/servers/57e0aa27-4adb-426a-9236-0543142651e0" status: 200 len: 1319 microversion: 2.1 time: 0.152941 Dec 14 03:21:48.399399 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 423/878] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:21:48 2021] GET /compute/v2.1/servers/57e0aa27-4adb-426a-9236-0543142651e0 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:21:48.833245 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-7aa56d25-8978-4ebc-b365-a8a0f38ff4f2 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:21:48.834277 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-7aa56d25-8978-4ebc-b365-a8a0f38ff4f2 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:21:48.840682 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7aa56d25-8978-4ebc-b365-a8a0f38ff4f2 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:21:48.841129 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7aa56d25-8978-4ebc-b365-a8a0f38ff4f2 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:21:48.841903 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7aa56d25-8978-4ebc-b365-a8a0f38ff4f2 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:21:48.842337 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7aa56d25-8978-4ebc-b365-a8a0f38ff4f2 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:21:48.871585 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-7aa56d25-8978-4ebc-b365-a8a0f38ff4f2 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042508 Dec 14 03:21:48.872126 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 456/879] 10.222.0.43 () {60 vars in 1342 bytes} [Tue Dec 14 03:21:48 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:21:49.416273 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-b6c089d5-90ac-4882-8825-113d1c2acd4e tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:21:49.417530 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-b6c089d5-90ac-4882-8825-113d1c2acd4e tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] [instance: 57e0aa27-4adb-426a-9236-0543142651e0] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:21:49.423873 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b6c089d5-90ac-4882-8825-113d1c2acd4e tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:21:49.424320 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b6c089d5-90ac-4882-8825-113d1c2acd4e tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:21:49.425100 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b6c089d5-90ac-4882-8825-113d1c2acd4e tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:21:49.425533 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b6c089d5-90ac-4882-8825-113d1c2acd4e tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:21:49.552389 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-b6c089d5-90ac-4882-8825-113d1c2acd4e tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bfec4b3f8b47cf93f7d07703365d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325c78a0c8574ce0bb38f768705a1181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:21:49.560068 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-b6c089d5-90ac-4882-8825-113d1c2acd4e tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /compute/v2.1/servers/57e0aa27-4adb-426a-9236-0543142651e0" status: 200 len: 1319 microversion: 2.1 time: 0.148208 Dec 14 03:21:49.560626 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 424/880] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:21:49 2021] GET /compute/v2.1/servers/57e0aa27-4adb-426a-9236-0543142651e0 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:21:49.882782 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-db5fdef4-859c-4b54-8a2e-1d87fc907998 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:21:49.883836 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-db5fdef4-859c-4b54-8a2e-1d87fc907998 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:21:49.889954 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-db5fdef4-859c-4b54-8a2e-1d87fc907998 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:21:49.890420 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-db5fdef4-859c-4b54-8a2e-1d87fc907998 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:21:49.891232 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-db5fdef4-859c-4b54-8a2e-1d87fc907998 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:21:49.891665 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-db5fdef4-859c-4b54-8a2e-1d87fc907998 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:21:49.919807 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-db5fdef4-859c-4b54-8a2e-1d87fc907998 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.040977 Dec 14 03:21:49.920353 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 457/881] 10.222.0.43 () {60 vars in 1342 bytes} [Tue Dec 14 03:21:49 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:21:49.974446 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-0fcdc81f-2484-42b9-8a2e-5879bbde284d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:21:49.974950 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-0fcdc81f-2484-42b9-8a2e-5879bbde284d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:21:49.981881 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-0fcdc81f-2484-42b9-8a2e-5879bbde284d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:21:49.982348 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-0fcdc81f-2484-42b9-8a2e-5879bbde284d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:21:49.983171 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-0fcdc81f-2484-42b9-8a2e-5879bbde284d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:21:49.983619 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-0fcdc81f-2484-42b9-8a2e-5879bbde284d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:21:50.008759 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-0fcdc81f-2484-42b9-8a2e-5879bbde284d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Going to try to terminate instance {{(pid=116071) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 14 03:21:50.088442 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-0fcdc81f-2484-42b9-8a2e-5879bbde284d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "DELETE /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 204 len: 0 microversion: 2.20 time: 0.117128 Dec 14 03:21:50.089037 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 425/882] 10.222.0.43 () {60 vars in 1279 bytes} [Tue Dec 14 03:21:49 2021] DELETE /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 14 03:21:50.097501 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-d22a43d7-b2ca-4c89-8002-59a49b0c66f3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:21:50.098115 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-d22a43d7-b2ca-4c89-8002-59a49b0c66f3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:21:50.104923 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d22a43d7-b2ca-4c89-8002-59a49b0c66f3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:21:50.105421 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d22a43d7-b2ca-4c89-8002-59a49b0c66f3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:21:50.106223 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d22a43d7-b2ca-4c89-8002-59a49b0c66f3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:21:50.106632 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d22a43d7-b2ca-4c89-8002-59a49b0c66f3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:21:50.236546 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-d22a43d7-b2ca-4c89-8002-59a49b0c66f3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:21:50.244558 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-d22a43d7-b2ca-4c89-8002-59a49b0c66f3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:21:50.246061 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-d22a43d7-b2ca-4c89-8002-59a49b0c66f3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:21:50.247246 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-d22a43d7-b2ca-4c89-8002-59a49b0c66f3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1723 microversion: 2.20 time: 0.153710 Dec 14 03:21:50.247805 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 458/883] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:21:50 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:21:50.577378 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-da1219be-c78e-4212-8abe-6a54ab8e8671 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:21:50.578081 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-da1219be-c78e-4212-8abe-6a54ab8e8671 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] [instance: 57e0aa27-4adb-426a-9236-0543142651e0] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:21:50.584275 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-da1219be-c78e-4212-8abe-6a54ab8e8671 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:21:50.584730 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-da1219be-c78e-4212-8abe-6a54ab8e8671 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:21:50.585499 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-da1219be-c78e-4212-8abe-6a54ab8e8671 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:21:50.586544 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-da1219be-c78e-4212-8abe-6a54ab8e8671 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:21:50.712647 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-da1219be-c78e-4212-8abe-6a54ab8e8671 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bfec4b3f8b47cf93f7d07703365d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325c78a0c8574ce0bb38f768705a1181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:21:50.719918 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-da1219be-c78e-4212-8abe-6a54ab8e8671 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /compute/v2.1/servers/57e0aa27-4adb-426a-9236-0543142651e0" status: 200 len: 1508 microversion: 2.1 time: 0.146650 Dec 14 03:21:50.720478 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 426/884] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:21:50 2021] GET /compute/v2.1/servers/57e0aa27-4adb-426a-9236-0543142651e0 => generated 1508 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:21:50.736313 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-d7c36426-87c5-4ed3-a708-7eeeb041b771 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e4c4f139-26a4-4f6f-accf-3380494de2ed", "device": "/dev/sdb"}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:21:50.737492 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-d7c36426-87c5-4ed3-a708-7eeeb041b771 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] [instance: 57e0aa27-4adb-426a-9236-0543142651e0] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:21:50.744250 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d7c36426-87c5-4ed3-a708-7eeeb041b771 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:21:50.744709 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d7c36426-87c5-4ed3-a708-7eeeb041b771 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:21:50.745495 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d7c36426-87c5-4ed3-a708-7eeeb041b771 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:21:50.745936 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d7c36426-87c5-4ed3-a708-7eeeb041b771 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:21:50.981362 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-d7c36426-87c5-4ed3-a708-7eeeb041b771 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "POST /compute/v2.1/servers/57e0aa27-4adb-426a-9236-0543142651e0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.248678 Dec 14 03:21:50.981990 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 459/885] 10.222.0.43 () {60 vars in 1322 bytes} [Tue Dec 14 03:21:50 2021] POST /compute/v2.1/servers/57e0aa27-4adb-426a-9236-0543142651e0/os-volume_attachments => generated 194 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:21:51.266975 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-3d0fb602-0d00-4965-999c-ef5c69f8b83c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:21:51.267724 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-3d0fb602-0d00-4965-999c-ef5c69f8b83c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:21:51.273414 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-3d0fb602-0d00-4965-999c-ef5c69f8b83c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:21:51.273856 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-3d0fb602-0d00-4965-999c-ef5c69f8b83c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:21:51.274622 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-3d0fb602-0d00-4965-999c-ef5c69f8b83c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:21:51.275072 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-3d0fb602-0d00-4965-999c-ef5c69f8b83c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:21:51.403164 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-3d0fb602-0d00-4965-999c-ef5c69f8b83c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:21:51.410920 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-3d0fb602-0d00-4965-999c-ef5c69f8b83c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:21:51.412428 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-3d0fb602-0d00-4965-999c-ef5c69f8b83c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:21:51.413563 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-3d0fb602-0d00-4965-999c-ef5c69f8b83c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1723 microversion: 2.20 time: 0.150235 Dec 14 03:21:51.414666 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 427/886] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:21:51 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:21:52.433910 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-ccab2886-9279-4c5e-81eb-18c20ef6331a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:21:52.434602 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-ccab2886-9279-4c5e-81eb-18c20ef6331a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:21:52.440666 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ccab2886-9279-4c5e-81eb-18c20ef6331a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:21:52.441114 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ccab2886-9279-4c5e-81eb-18c20ef6331a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:21:52.441875 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ccab2886-9279-4c5e-81eb-18c20ef6331a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:21:52.442303 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ccab2886-9279-4c5e-81eb-18c20ef6331a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:21:52.571478 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-ccab2886-9279-4c5e-81eb-18c20ef6331a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:21:52.579824 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-ccab2886-9279-4c5e-81eb-18c20ef6331a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:21:52.581335 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-ccab2886-9279-4c5e-81eb-18c20ef6331a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:21:52.582508 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-ccab2886-9279-4c5e-81eb-18c20ef6331a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1723 microversion: 2.20 time: 0.153663 Dec 14 03:21:52.583082 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 460/887] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:21:52 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 14 03:21:53.323318 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [req-c25c07ab-a292-4c01-aec2-a28208dbb292 req-e6f05574-8049-41c9-87b2-2d06b4841005 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86395107-d320-45d8-83de-f1848858be10", "name": "network-vif-deleted", "tag": "85ceb16f-0c27-48e9-ab76-5cd49eb12802"}]} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:21:53.325533 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:21:53.325533 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: warnings.warn(msg) Dec 14 03:21:53.335134 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [req-c25c07ab-a292-4c01-aec2-a28208dbb292 req-e6f05574-8049-41c9-87b2-2d06b4841005 service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:21:53.336240 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [req-c25c07ab-a292-4c01-aec2-a28208dbb292 req-e6f05574-8049-41c9-87b2-2d06b4841005 service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:21:53.356159 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.compute.server_external_events [req-c25c07ab-a292-4c01-aec2-a28208dbb292 req-e6f05574-8049-41c9-87b2-2d06b4841005 service nova] Creating event network-vif-deleted:85ceb16f-0c27-48e9-ab76-5cd49eb12802 for instance 86395107-d320-45d8-83de-f1848858be10 on hv-cinder-81803 Dec 14 03:21:53.361322 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [req-c25c07ab-a292-4c01-aec2-a28208dbb292 req-e6f05574-8049-41c9-87b2-2d06b4841005 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043080 Dec 14 03:21:53.361955 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 428/888] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Dec 14 03:21:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:21:53.600881 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-30bdbac3-367d-48ad-8bd5-da340811fddb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:21:53.601624 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-30bdbac3-367d-48ad-8bd5-da340811fddb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:21:53.607849 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-30bdbac3-367d-48ad-8bd5-da340811fddb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:21:53.608427 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-30bdbac3-367d-48ad-8bd5-da340811fddb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:21:53.609223 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-30bdbac3-367d-48ad-8bd5-da340811fddb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:21:53.609662 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-30bdbac3-367d-48ad-8bd5-da340811fddb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:21:53.642162 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-30bdbac3-367d-48ad-8bd5-da340811fddb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:21:53.642620 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-30bdbac3-367d-48ad-8bd5-da340811fddb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:21:53.643083 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.objects.instance [None req-30bdbac3-367d-48ad-8bd5-da340811fddb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lazy-loading 'fault' on Instance uuid 86395107-d320-45d8-83de-f1848858be10 {{(pid=116072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 14 03:21:53.682567 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-30bdbac3-367d-48ad-8bd5-da340811fddb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:21:53.690484 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-30bdbac3-367d-48ad-8bd5-da340811fddb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:21:53.692073 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-30bdbac3-367d-48ad-8bd5-da340811fddb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:21:53.693251 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-30bdbac3-367d-48ad-8bd5-da340811fddb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 200 len: 1371 microversion: 2.20 time: 0.096057 Dec 14 03:21:53.693803 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 461/889] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:21:53 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 1371 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:21:54.712310 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-483a504b-e345-4c29-b000-16a45b4c45dc tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:21:54.713004 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-483a504b-e345-4c29-b000-16a45b4c45dc tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:21:54.719656 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-483a504b-e345-4c29-b000-16a45b4c45dc tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:21:54.720111 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-483a504b-e345-4c29-b000-16a45b4c45dc tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:21:54.720884 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-483a504b-e345-4c29-b000-16a45b4c45dc tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:21:54.721319 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-483a504b-e345-4c29-b000-16a45b4c45dc tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:21:54.735796 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.wsgi [None req-483a504b-e345-4c29-b000-16a45b4c45dc tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] HTTP exception thrown: Instance 86395107-d320-45d8-83de-f1848858be10 could not be found. Dec 14 03:21:54.736382 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-483a504b-e345-4c29-b000-16a45b4c45dc tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Returning 404 to user: Instance 86395107-d320-45d8-83de-f1848858be10 could not be found. {{(pid=116071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 03:21:54.737194 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-483a504b-e345-4c29-b000-16a45b4c45dc tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 404 len: 111 microversion: 2.20 time: 0.028951 Dec 14 03:21:54.737976 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 429/890] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:21:54 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 14 03:21:54.746829 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-f4436fd8-c167-4fd3-aa39-410ffbd2ee7c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '.version_select at 0x7fa5080ab0d0>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:21:54.771637 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-f4436fd8-c167-4fd3-aa39-410ffbd2ee7c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1181700061" status: 204 len: 0 microversion: 2.20 time: 0.028474 Dec 14 03:21:54.772317 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 462/891] 10.222.0.43 () {60 vars in 1261 bytes} [Tue Dec 14 03:21:54 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1181700061 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 14 03:21:55.457820 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-309b96b0-cce8-482f-9da8-ad68ef6b75b3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'create', calling method: .version_select at 0x7fa5036ceca0>, body: {"keypair": {"name": "tempest-keypair-2040974441"}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:21:55.470840 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.quota [None req-309b96b0-cce8-482f-9da8-ad68ef6b75b3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Getting quotas for project da53d564588b46b7bd658659f40a6ded. Resources: {'key_pairs'} {{(pid=116071) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 03:21:55.474523 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.quota [None req-309b96b0-cce8-482f-9da8-ad68ef6b75b3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Getting quotas for user 0a4d52d1d56e44fe97650262ca2e68df and project da53d564588b46b7bd658659f40a6ded. Resources: {'key_pairs'} {{(pid=116071) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 03:21:55.692735 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.quota [None req-309b96b0-cce8-482f-9da8-ad68ef6b75b3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Getting quotas for project da53d564588b46b7bd658659f40a6ded. Resources: {'key_pairs'} {{(pid=116071) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 03:21:55.696899 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.quota [None req-309b96b0-cce8-482f-9da8-ad68ef6b75b3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Getting quotas for user 0a4d52d1d56e44fe97650262ca2e68df and project da53d564588b46b7bd658659f40a6ded. Resources: {'key_pairs'} {{(pid=116071) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 03:21:55.709559 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-309b96b0-cce8-482f-9da8-ad68ef6b75b3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 0.256376 Dec 14 03:21:55.710069 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 430/892] 10.222.0.43 () {62 vars in 1198 bytes} [Tue Dec 14 03:21:55 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 258 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Dec 14 03:21:56.934565 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-1f06e418-00e0-4aa1-a937-904243101829 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-874242746", "imageRef": "4fff76a9-6620-4bda-b1ec-2cd3719c946a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "61e8c126-6b7d-4549-9293-90629e6175d3"}], "security_groups": [{"name": "tempest-securitygroup--92560242"}], "key_name": "tempest-keypair-2040974441", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:21:57.032502 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.network.neutron [None req-1f06e418-00e0-4aa1-a937-904243101829 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] validate_networks() for [('61e8c126-6b7d-4549-9293-90629e6175d3', None, None, None, None, None)] {{(pid=116072) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 14 03:21:57.383134 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-1f06e418-00e0-4aa1-a937-904243101829 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Flavor limits 0:0:0 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 14 03:21:57.383561 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-1f06e418-00e0-4aa1-a937-904243101829 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Image limits 0:0:0 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 14 03:21:57.384044 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-1f06e418-00e0-4aa1-a937-904243101829 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Flavor pref 0:0:0 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 14 03:21:57.384456 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-1f06e418-00e0-4aa1-a937-904243101829 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Image pref 0:0:0 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 14 03:21:57.385016 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-1f06e418-00e0-4aa1-a937-904243101829 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 14 03:21:57.396704 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1f06e418-00e0-4aa1-a937-904243101829 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:21:57.397054 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1f06e418-00e0-4aa1-a937-904243101829 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:21:57.397890 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1f06e418-00e0-4aa1-a937-904243101829 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:21:57.398328 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1f06e418-00e0-4aa1-a937-904243101829 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:21:57.415843 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.quota [None req-1f06e418-00e0-4aa1-a937-904243101829 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Getting quotas for project da53d564588b46b7bd658659f40a6ded. Resources: {'cores', 'instances', 'ram'} {{(pid=116072) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 03:21:57.419775 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.quota [None req-1f06e418-00e0-4aa1-a937-904243101829 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Getting quotas for user 0a4d52d1d56e44fe97650262ca2e68df and project da53d564588b46b7bd658659f40a6ded. Resources: {'cores', 'instances', 'ram'} {{(pid=116072) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 03:21:57.431328 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-1f06e418-00e0-4aa1-a937-904243101829 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Going to run 1 instances... {{(pid=116072) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 14 03:21:57.433650 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-1f06e418-00e0-4aa1-a937-904243101829 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4fff76a9-6620-4bda-b1ec-2cd3719c946a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 14 03:21:57.479104 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-1f06e418-00e0-4aa1-a937-904243101829 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.548772 Dec 14 03:21:57.479748 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 463/893] 10.222.0.43 () {62 vars in 1187 bytes} [Tue Dec 14 03:21:56 2021] POST /compute/v2.1/servers => generated 400 bytes in 550 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Dec 14 03:21:57.490310 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-c0dbb584-0604-43ca-ba56-67e13a31a369 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:21:57.490901 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-c0dbb584-0604-43ca-ba56-67e13a31a369 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:21:57.542311 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-c0dbb584-0604-43ca-ba56-67e13a31a369 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:21:57.550007 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-c0dbb584-0604-43ca-ba56-67e13a31a369 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:21:57.551514 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-c0dbb584-0604-43ca-ba56-67e13a31a369 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:21:57.552590 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-c0dbb584-0604-43ca-ba56-67e13a31a369 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f" status: 200 len: 1281 microversion: 2.20 time: 0.066659 Dec 14 03:21:57.553126 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 431/894] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:21:57 2021] GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f => generated 1281 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 14 03:21:58.571544 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-7f0dfe0f-f981-4d2e-b1a3-03410ce4d3d7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:21:58.572166 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-7f0dfe0f-f981-4d2e-b1a3-03410ce4d3d7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:21:58.587914 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7f0dfe0f-f981-4d2e-b1a3-03410ce4d3d7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:21:58.588438 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7f0dfe0f-f981-4d2e-b1a3-03410ce4d3d7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:21:58.590328 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7f0dfe0f-f981-4d2e-b1a3-03410ce4d3d7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:21:58.590872 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7f0dfe0f-f981-4d2e-b1a3-03410ce4d3d7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:21:58.657706 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-7f0dfe0f-f981-4d2e-b1a3-03410ce4d3d7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:21:58.668360 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-7f0dfe0f-f981-4d2e-b1a3-03410ce4d3d7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:21:58.670364 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-7f0dfe0f-f981-4d2e-b1a3-03410ce4d3d7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:21:58.671527 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-7f0dfe0f-f981-4d2e-b1a3-03410ce4d3d7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f" status: 200 len: 1339 microversion: 2.20 time: 0.104256 Dec 14 03:21:58.672682 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 464/895] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:21:58 2021] GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f => generated 1339 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:21:59.689884 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-29fb29ce-78db-418b-af54-31f07ead5a51 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:21:59.690500 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-29fb29ce-78db-418b-af54-31f07ead5a51 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:21:59.696476 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-29fb29ce-78db-418b-af54-31f07ead5a51 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:21:59.696929 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-29fb29ce-78db-418b-af54-31f07ead5a51 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:21:59.697709 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-29fb29ce-78db-418b-af54-31f07ead5a51 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:21:59.698145 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-29fb29ce-78db-418b-af54-31f07ead5a51 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:21:59.826838 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-29fb29ce-78db-418b-af54-31f07ead5a51 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:21:59.834435 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-29fb29ce-78db-418b-af54-31f07ead5a51 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:21:59.836470 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-29fb29ce-78db-418b-af54-31f07ead5a51 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:21:59.837570 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-29fb29ce-78db-418b-af54-31f07ead5a51 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f" status: 200 len: 1405 microversion: 2.20 time: 0.151394 Dec 14 03:21:59.838119 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 432/896] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:21:59 2021] GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f => generated 1405 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:22:00.855857 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-6e410069-f10a-47a8-8181-4f77bb8f7269 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:22:00.856475 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-6e410069-f10a-47a8-8181-4f77bb8f7269 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:22:00.862959 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6e410069-f10a-47a8-8181-4f77bb8f7269 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:00.863444 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6e410069-f10a-47a8-8181-4f77bb8f7269 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:00.864215 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6e410069-f10a-47a8-8181-4f77bb8f7269 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:00.864653 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6e410069-f10a-47a8-8181-4f77bb8f7269 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:00.989299 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-6e410069-f10a-47a8-8181-4f77bb8f7269 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:22:00.996982 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-6e410069-f10a-47a8-8181-4f77bb8f7269 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:22:00.998562 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-6e410069-f10a-47a8-8181-4f77bb8f7269 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:22:00.999718 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-6e410069-f10a-47a8-8181-4f77bb8f7269 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f" status: 200 len: 1405 microversion: 2.20 time: 0.147542 Dec 14 03:22:01.000279 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 465/897] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:22:00 2021] GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f => generated 1405 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:22:02.017540 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-6233d3ee-ed17-44e0-8687-1fb02b56d134 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:22:02.018151 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-6233d3ee-ed17-44e0-8687-1fb02b56d134 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:22:02.024399 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-6233d3ee-ed17-44e0-8687-1fb02b56d134 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:02.024846 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-6233d3ee-ed17-44e0-8687-1fb02b56d134 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:02.025747 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-6233d3ee-ed17-44e0-8687-1fb02b56d134 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:02.026063 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-6233d3ee-ed17-44e0-8687-1fb02b56d134 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:02.157836 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-6233d3ee-ed17-44e0-8687-1fb02b56d134 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:22:02.166171 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-6233d3ee-ed17-44e0-8687-1fb02b56d134 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:22:02.167601 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-6233d3ee-ed17-44e0-8687-1fb02b56d134 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:22:02.168716 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-6233d3ee-ed17-44e0-8687-1fb02b56d134 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f" status: 200 len: 1405 microversion: 2.20 time: 0.154898 Dec 14 03:22:02.169277 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 433/898] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:22:02 2021] GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f => generated 1405 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:22:02.752672 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [req-724789b1-3ca1-45e0-9c1b-10f609bd95d8 req-0ac65ad6-1420-470a-82c7-60856ace8fb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "279d5888-562c-4c6a-b27c-3f8e84fd510f", "tag": "9eee83b0-b14c-403e-a6bd-7d2515f7e214"}]} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:22:02.754209 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:22:02.754209 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: warnings.warn(msg) Dec 14 03:22:02.761748 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-724789b1-3ca1-45e0-9c1b-10f609bd95d8 req-0ac65ad6-1420-470a-82c7-60856ace8fb0 service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:02.762574 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-724789b1-3ca1-45e0-9c1b-10f609bd95d8 req-0ac65ad6-1420-470a-82c7-60856ace8fb0 service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:02.774994 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.compute.server_external_events [req-724789b1-3ca1-45e0-9c1b-10f609bd95d8 req-0ac65ad6-1420-470a-82c7-60856ace8fb0 service nova] Creating event network-changed:9eee83b0-b14c-403e-a6bd-7d2515f7e214 for instance 279d5888-562c-4c6a-b27c-3f8e84fd510f on hv-cinder-81803 Dec 14 03:22:02.780361 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [req-724789b1-3ca1-45e0-9c1b-10f609bd95d8 req-0ac65ad6-1420-470a-82c7-60856ace8fb0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031056 Dec 14 03:22:02.780916 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 466/899] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Dec 14 03:22:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:22:03.187000 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-4e06ea42-2cfb-4410-a771-3689dac612fc tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:22:03.187633 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-4e06ea42-2cfb-4410-a771-3689dac612fc tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:22:03.193861 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-4e06ea42-2cfb-4410-a771-3689dac612fc tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:03.194308 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-4e06ea42-2cfb-4410-a771-3689dac612fc tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:03.195613 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-4e06ea42-2cfb-4410-a771-3689dac612fc tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:03.196045 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-4e06ea42-2cfb-4410-a771-3689dac612fc tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:03.321756 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-4e06ea42-2cfb-4410-a771-3689dac612fc tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:22:03.329372 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-4e06ea42-2cfb-4410-a771-3689dac612fc tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:22:03.330859 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-4e06ea42-2cfb-4410-a771-3689dac612fc tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:22:03.331976 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-4e06ea42-2cfb-4410-a771-3689dac612fc tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f" status: 200 len: 1405 microversion: 2.20 time: 0.148618 Dec 14 03:22:03.332531 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 434/900] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:22:03 2021] GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f => generated 1405 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:22:04.350584 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-0a49f5fe-f8af-4c94-9574-1a730652204a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:22:04.351870 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-0a49f5fe-f8af-4c94-9574-1a730652204a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:22:04.358153 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0a49f5fe-f8af-4c94-9574-1a730652204a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:04.358551 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0a49f5fe-f8af-4c94-9574-1a730652204a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:04.359350 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0a49f5fe-f8af-4c94-9574-1a730652204a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:04.359794 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0a49f5fe-f8af-4c94-9574-1a730652204a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:04.485918 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-0a49f5fe-f8af-4c94-9574-1a730652204a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:22:04.494334 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-0a49f5fe-f8af-4c94-9574-1a730652204a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:22:04.495865 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-0a49f5fe-f8af-4c94-9574-1a730652204a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:22:04.496998 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-0a49f5fe-f8af-4c94-9574-1a730652204a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f" status: 200 len: 1405 microversion: 2.20 time: 0.150913 Dec 14 03:22:04.497553 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 467/901] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:22:04 2021] GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f => generated 1405 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:22:05.515154 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-708f1983-2383-4d42-a298-ce0ebad69bc9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:22:05.515750 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-708f1983-2383-4d42-a298-ce0ebad69bc9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:22:05.522000 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-708f1983-2383-4d42-a298-ce0ebad69bc9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:05.523078 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-708f1983-2383-4d42-a298-ce0ebad69bc9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:05.523866 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-708f1983-2383-4d42-a298-ce0ebad69bc9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:05.524306 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-708f1983-2383-4d42-a298-ce0ebad69bc9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:05.651298 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-708f1983-2383-4d42-a298-ce0ebad69bc9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:22:05.659061 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-708f1983-2383-4d42-a298-ce0ebad69bc9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:22:05.660556 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-708f1983-2383-4d42-a298-ce0ebad69bc9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:22:05.661646 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-708f1983-2383-4d42-a298-ce0ebad69bc9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f" status: 200 len: 1405 microversion: 2.20 time: 0.150211 Dec 14 03:22:05.662196 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 435/902] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:22:05 2021] GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f => generated 1405 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:22:06.680115 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-4ebb7249-9b80-4ea5-ab57-79997af38048 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:22:06.680731 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-4ebb7249-9b80-4ea5-ab57-79997af38048 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:22:06.686993 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4ebb7249-9b80-4ea5-ab57-79997af38048 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:06.687475 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4ebb7249-9b80-4ea5-ab57-79997af38048 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:06.688249 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4ebb7249-9b80-4ea5-ab57-79997af38048 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:06.688685 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4ebb7249-9b80-4ea5-ab57-79997af38048 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:06.814795 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-4ebb7249-9b80-4ea5-ab57-79997af38048 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:22:06.822359 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-4ebb7249-9b80-4ea5-ab57-79997af38048 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:22:06.823885 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-4ebb7249-9b80-4ea5-ab57-79997af38048 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:22:06.824982 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-4ebb7249-9b80-4ea5-ab57-79997af38048 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f" status: 200 len: 1405 microversion: 2.20 time: 0.149173 Dec 14 03:22:06.825533 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 468/903] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:22:06 2021] GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f => generated 1405 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:22:07.842883 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-fe488376-8a5c-4342-a054-e60d4342a622 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:22:07.843579 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-fe488376-8a5c-4342-a054-e60d4342a622 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:22:07.849870 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-fe488376-8a5c-4342-a054-e60d4342a622 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:07.850511 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-fe488376-8a5c-4342-a054-e60d4342a622 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:07.851848 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-fe488376-8a5c-4342-a054-e60d4342a622 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:07.852286 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-fe488376-8a5c-4342-a054-e60d4342a622 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:07.981755 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-fe488376-8a5c-4342-a054-e60d4342a622 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:22:07.989684 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-fe488376-8a5c-4342-a054-e60d4342a622 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:22:07.991209 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-fe488376-8a5c-4342-a054-e60d4342a622 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:22:07.992301 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-fe488376-8a5c-4342-a054-e60d4342a622 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f" status: 200 len: 1405 microversion: 2.20 time: 0.153111 Dec 14 03:22:07.992858 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 436/904] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:22:07 2021] GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f => generated 1405 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:22:09.009310 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-c104f78c-00dd-463a-ab4f-64d7d18a9acb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:22:09.009918 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-c104f78c-00dd-463a-ab4f-64d7d18a9acb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:22:09.016124 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c104f78c-00dd-463a-ab4f-64d7d18a9acb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:09.016577 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c104f78c-00dd-463a-ab4f-64d7d18a9acb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:09.017355 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c104f78c-00dd-463a-ab4f-64d7d18a9acb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:09.017799 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c104f78c-00dd-463a-ab4f-64d7d18a9acb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:09.141952 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-c104f78c-00dd-463a-ab4f-64d7d18a9acb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:22:09.149509 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-c104f78c-00dd-463a-ab4f-64d7d18a9acb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:22:09.151001 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-c104f78c-00dd-463a-ab4f-64d7d18a9acb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:22:09.152125 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-c104f78c-00dd-463a-ab4f-64d7d18a9acb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f" status: 200 len: 1405 microversion: 2.20 time: 0.146461 Dec 14 03:22:09.152673 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 469/905] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:22:09 2021] GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f => generated 1405 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:22:10.169619 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-ca07a093-95b5-403a-9240-06a84a3e8905 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:22:10.170259 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-ca07a093-95b5-403a-9240-06a84a3e8905 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:22:10.176612 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ca07a093-95b5-403a-9240-06a84a3e8905 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:10.177128 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ca07a093-95b5-403a-9240-06a84a3e8905 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:10.177982 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ca07a093-95b5-403a-9240-06a84a3e8905 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:10.178424 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ca07a093-95b5-403a-9240-06a84a3e8905 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:10.314451 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-ca07a093-95b5-403a-9240-06a84a3e8905 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:22:10.322691 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-ca07a093-95b5-403a-9240-06a84a3e8905 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:22:10.324221 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-ca07a093-95b5-403a-9240-06a84a3e8905 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:22:10.325314 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-ca07a093-95b5-403a-9240-06a84a3e8905 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f" status: 200 len: 1405 microversion: 2.20 time: 0.159337 Dec 14 03:22:10.325862 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 437/906] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:22:10 2021] GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f => generated 1405 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:22:11.342565 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-97a1e7b2-3c4c-410a-9eb7-09a1b7d18662 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:22:11.343137 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-97a1e7b2-3c4c-410a-9eb7-09a1b7d18662 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:22:11.349322 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-97a1e7b2-3c4c-410a-9eb7-09a1b7d18662 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:11.349770 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-97a1e7b2-3c4c-410a-9eb7-09a1b7d18662 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:11.350545 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-97a1e7b2-3c4c-410a-9eb7-09a1b7d18662 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:11.350979 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-97a1e7b2-3c4c-410a-9eb7-09a1b7d18662 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:11.479420 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-97a1e7b2-3c4c-410a-9eb7-09a1b7d18662 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:22:11.486962 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-97a1e7b2-3c4c-410a-9eb7-09a1b7d18662 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:22:11.488731 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-97a1e7b2-3c4c-410a-9eb7-09a1b7d18662 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:22:11.489824 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-97a1e7b2-3c4c-410a-9eb7-09a1b7d18662 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f" status: 200 len: 1405 microversion: 2.20 time: 0.151038 Dec 14 03:22:11.490374 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 470/907] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:22:11 2021] GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f => generated 1405 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:22:12.507996 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-a747193b-f9e4-436a-9856-922030d51aad tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:22:12.508578 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-a747193b-f9e4-436a-9856-922030d51aad tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:22:12.514684 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a747193b-f9e4-436a-9856-922030d51aad tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:12.515176 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a747193b-f9e4-436a-9856-922030d51aad tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:12.516026 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a747193b-f9e4-436a-9856-922030d51aad tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:12.516451 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a747193b-f9e4-436a-9856-922030d51aad tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:12.645396 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-a747193b-f9e4-436a-9856-922030d51aad tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:22:12.653671 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-a747193b-f9e4-436a-9856-922030d51aad tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:22:12.655199 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-a747193b-f9e4-436a-9856-922030d51aad tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:22:12.656300 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-a747193b-f9e4-436a-9856-922030d51aad tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f" status: 200 len: 1405 microversion: 2.20 time: 0.152102 Dec 14 03:22:12.656864 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 438/908] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:22:12 2021] GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f => generated 1405 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:22:13.290824 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-de5cfd84-a3df-42ce-a755-99145a07ef07 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:22:13.291357 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-de5cfd84-a3df-42ce-a755-99145a07ef07 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] [instance: 57e0aa27-4adb-426a-9236-0543142651e0] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:22:13.297504 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-de5cfd84-a3df-42ce-a755-99145a07ef07 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:13.297952 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-de5cfd84-a3df-42ce-a755-99145a07ef07 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:13.298723 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-de5cfd84-a3df-42ce-a755-99145a07ef07 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:13.299200 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-de5cfd84-a3df-42ce-a755-99145a07ef07 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:13.375116 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.objects.instance [None req-de5cfd84-a3df-42ce-a755-99145a07ef07 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lazy-loading 'services' on Instance uuid 57e0aa27-4adb-426a-9236-0543142651e0 {{(pid=116072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 14 03:22:13.440741 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-de5cfd84-a3df-42ce-a755-99145a07ef07 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "DELETE /compute/v2.1/servers/57e0aa27-4adb-426a-9236-0543142651e0/os-volume_attachments/e4c4f139-26a4-4f6f-accf-3380494de2ed" status: 202 len: 0 microversion: 2.1 time: 0.154067 Dec 14 03:22:13.441353 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 471/909] 10.222.0.43 () {58 vars in 1415 bytes} [Tue Dec 14 03:22:13 2021] DELETE /compute/v2.1/servers/57e0aa27-4adb-426a-9236-0543142651e0/os-volume_attachments/e4c4f139-26a4-4f6f-accf-3380494de2ed => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:22:13.675469 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-01e58299-1e0f-44b5-882a-88ed4d4b9589 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:22:13.676081 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-01e58299-1e0f-44b5-882a-88ed4d4b9589 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:22:13.682261 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-01e58299-1e0f-44b5-882a-88ed4d4b9589 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:13.682707 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-01e58299-1e0f-44b5-882a-88ed4d4b9589 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:13.683518 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-01e58299-1e0f-44b5-882a-88ed4d4b9589 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:13.683954 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-01e58299-1e0f-44b5-882a-88ed4d4b9589 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:13.811343 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-01e58299-1e0f-44b5-882a-88ed4d4b9589 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:22:13.819549 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-01e58299-1e0f-44b5-882a-88ed4d4b9589 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:22:13.821019 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-01e58299-1e0f-44b5-882a-88ed4d4b9589 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:22:13.822116 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-01e58299-1e0f-44b5-882a-88ed4d4b9589 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f" status: 200 len: 1405 microversion: 2.20 time: 0.150432 Dec 14 03:22:13.822674 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 439/910] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:22:13 2021] GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f => generated 1405 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:22:14.096667 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [req-229d1e64-6d90-498f-a68f-c67c7cfc44f5 req-db8a84cb-0661-44c9-bfa4-4714b83253ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "279d5888-562c-4c6a-b27c-3f8e84fd510f", "name": "network-vif-plugged", "status": "completed", "tag": "9eee83b0-b14c-403e-a6bd-7d2515f7e214"}]} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:22:14.098222 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:22:14.098222 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: warnings.warn(msg) Dec 14 03:22:14.106087 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-229d1e64-6d90-498f-a68f-c67c7cfc44f5 req-db8a84cb-0661-44c9-bfa4-4714b83253ba service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:14.106490 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-229d1e64-6d90-498f-a68f-c67c7cfc44f5 req-db8a84cb-0661-44c9-bfa4-4714b83253ba service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:14.119970 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.compute.server_external_events [req-229d1e64-6d90-498f-a68f-c67c7cfc44f5 req-db8a84cb-0661-44c9-bfa4-4714b83253ba service nova] Creating event network-vif-plugged:9eee83b0-b14c-403e-a6bd-7d2515f7e214 for instance 279d5888-562c-4c6a-b27c-3f8e84fd510f on hv-cinder-81803 Dec 14 03:22:14.124871 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [req-229d1e64-6d90-498f-a68f-c67c7cfc44f5 req-db8a84cb-0661-44c9-bfa4-4714b83253ba service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032285 Dec 14 03:22:14.125636 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 472/911] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Dec 14 03:22:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:22:14.544145 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-7c9ed68d-5ff3-41ea-9788-cd8a49ae16d4 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:22:14.544635 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-7c9ed68d-5ff3-41ea-9788-cd8a49ae16d4 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] [instance: 57e0aa27-4adb-426a-9236-0543142651e0] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:22:14.550375 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-7c9ed68d-5ff3-41ea-9788-cd8a49ae16d4 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:14.550820 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-7c9ed68d-5ff3-41ea-9788-cd8a49ae16d4 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:14.551623 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-7c9ed68d-5ff3-41ea-9788-cd8a49ae16d4 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:14.552058 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-7c9ed68d-5ff3-41ea-9788-cd8a49ae16d4 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:14.575833 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-7c9ed68d-5ff3-41ea-9788-cd8a49ae16d4 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] [instance: 57e0aa27-4adb-426a-9236-0543142651e0] Going to try to terminate instance {{(pid=116071) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 14 03:22:14.646058 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-7c9ed68d-5ff3-41ea-9788-cd8a49ae16d4 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "DELETE /compute/v2.1/servers/57e0aa27-4adb-426a-9236-0543142651e0" status: 204 len: 0 microversion: 2.1 time: 0.105152 Dec 14 03:22:14.646542 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 440/912] 10.222.0.43 () {58 vars in 1238 bytes} [Tue Dec 14 03:22:14 2021] DELETE /compute/v2.1/servers/57e0aa27-4adb-426a-9236-0543142651e0 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 14 03:22:14.655415 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-160abed3-690d-4359-9ff9-a30434a0ed83 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:22:14.656123 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-160abed3-690d-4359-9ff9-a30434a0ed83 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] [instance: 57e0aa27-4adb-426a-9236-0543142651e0] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:22:14.662612 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-160abed3-690d-4359-9ff9-a30434a0ed83 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:14.663701 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-160abed3-690d-4359-9ff9-a30434a0ed83 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:14.664475 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-160abed3-690d-4359-9ff9-a30434a0ed83 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:14.664911 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-160abed3-690d-4359-9ff9-a30434a0ed83 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:14.791077 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-160abed3-690d-4359-9ff9-a30434a0ed83 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bfec4b3f8b47cf93f7d07703365d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325c78a0c8574ce0bb38f768705a1181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:22:14.798681 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-160abed3-690d-4359-9ff9-a30434a0ed83 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /compute/v2.1/servers/57e0aa27-4adb-426a-9236-0543142651e0" status: 200 len: 1560 microversion: 2.1 time: 0.147256 Dec 14 03:22:14.799271 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 473/913] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:22:14 2021] GET /compute/v2.1/servers/57e0aa27-4adb-426a-9236-0543142651e0 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:22:14.840688 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-b0348eb1-3cc0-49f6-b06b-c80b2f4e8864 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:22:14.841377 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-b0348eb1-3cc0-49f6-b06b-c80b2f4e8864 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:22:14.847538 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b0348eb1-3cc0-49f6-b06b-c80b2f4e8864 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:14.847984 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b0348eb1-3cc0-49f6-b06b-c80b2f4e8864 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:14.848754 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b0348eb1-3cc0-49f6-b06b-c80b2f4e8864 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:14.849192 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b0348eb1-3cc0-49f6-b06b-c80b2f4e8864 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:14.986128 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-b0348eb1-3cc0-49f6-b06b-c80b2f4e8864 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:22:14.994198 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-b0348eb1-3cc0-49f6-b06b-c80b2f4e8864 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:22:14.995778 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-b0348eb1-3cc0-49f6-b06b-c80b2f4e8864 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:22:14.996861 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-b0348eb1-3cc0-49f6-b06b-c80b2f4e8864 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f" status: 200 len: 1405 microversion: 2.20 time: 0.160321 Dec 14 03:22:14.997413 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 441/914] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:22:14 2021] GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f => generated 1405 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:22:15.815595 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-862657dd-caad-4874-9c5a-f2048c06e9dd tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:22:15.816219 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-862657dd-caad-4874-9c5a-f2048c06e9dd tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] [instance: 57e0aa27-4adb-426a-9236-0543142651e0] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:22:15.822531 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-862657dd-caad-4874-9c5a-f2048c06e9dd tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:15.822979 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-862657dd-caad-4874-9c5a-f2048c06e9dd tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:15.823785 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-862657dd-caad-4874-9c5a-f2048c06e9dd tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:15.824225 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-862657dd-caad-4874-9c5a-f2048c06e9dd tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:15.950644 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-862657dd-caad-4874-9c5a-f2048c06e9dd tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bfec4b3f8b47cf93f7d07703365d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325c78a0c8574ce0bb38f768705a1181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:22:15.958166 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-862657dd-caad-4874-9c5a-f2048c06e9dd tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /compute/v2.1/servers/57e0aa27-4adb-426a-9236-0543142651e0" status: 200 len: 1514 microversion: 2.1 time: 0.146209 Dec 14 03:22:15.958825 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 474/915] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:22:15 2021] GET /compute/v2.1/servers/57e0aa27-4adb-426a-9236-0543142651e0 => generated 1514 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:22:16.015280 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-dc1fb5dc-dd84-45ac-b102-9a19b55e996a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:22:16.015895 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-dc1fb5dc-dd84-45ac-b102-9a19b55e996a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:22:16.022130 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-dc1fb5dc-dd84-45ac-b102-9a19b55e996a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:16.022579 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-dc1fb5dc-dd84-45ac-b102-9a19b55e996a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:16.023383 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-dc1fb5dc-dd84-45ac-b102-9a19b55e996a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:16.023829 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-dc1fb5dc-dd84-45ac-b102-9a19b55e996a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:16.151954 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-dc1fb5dc-dd84-45ac-b102-9a19b55e996a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:22:16.160517 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-dc1fb5dc-dd84-45ac-b102-9a19b55e996a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:22:16.162056 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-dc1fb5dc-dd84-45ac-b102-9a19b55e996a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:22:16.163817 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-dc1fb5dc-dd84-45ac-b102-9a19b55e996a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f" status: 200 len: 1405 microversion: 2.20 time: 0.152278 Dec 14 03:22:16.164409 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 442/916] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:22:16 2021] GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f => generated 1405 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:22:16.974974 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-8c460f2f-f24e-4146-9724-974243f7cce5 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:22:16.975623 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-8c460f2f-f24e-4146-9724-974243f7cce5 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] [instance: 57e0aa27-4adb-426a-9236-0543142651e0] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:22:16.981983 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8c460f2f-f24e-4146-9724-974243f7cce5 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:16.982558 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8c460f2f-f24e-4146-9724-974243f7cce5 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:16.983360 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8c460f2f-f24e-4146-9724-974243f7cce5 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:16.983793 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8c460f2f-f24e-4146-9724-974243f7cce5 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:17.114575 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-8c460f2f-f24e-4146-9724-974243f7cce5 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bfec4b3f8b47cf93f7d07703365d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325c78a0c8574ce0bb38f768705a1181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:22:17.122283 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-8c460f2f-f24e-4146-9724-974243f7cce5 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /compute/v2.1/servers/57e0aa27-4adb-426a-9236-0543142651e0" status: 200 len: 1514 microversion: 2.1 time: 0.150978 Dec 14 03:22:17.122838 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 475/917] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:22:16 2021] GET /compute/v2.1/servers/57e0aa27-4adb-426a-9236-0543142651e0 => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:22:17.181869 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-16947703-7e08-4c52-a5cc-96232a87aa97 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:22:17.182477 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-16947703-7e08-4c52-a5cc-96232a87aa97 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:22:17.188716 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-16947703-7e08-4c52-a5cc-96232a87aa97 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:17.189164 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-16947703-7e08-4c52-a5cc-96232a87aa97 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:17.189939 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-16947703-7e08-4c52-a5cc-96232a87aa97 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:17.190376 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-16947703-7e08-4c52-a5cc-96232a87aa97 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:17.314522 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-16947703-7e08-4c52-a5cc-96232a87aa97 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:22:17.322245 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-16947703-7e08-4c52-a5cc-96232a87aa97 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:22:17.323798 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-16947703-7e08-4c52-a5cc-96232a87aa97 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:22:17.324945 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-16947703-7e08-4c52-a5cc-96232a87aa97 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f" status: 200 len: 1598 microversion: 2.20 time: 0.147275 Dec 14 03:22:17.325493 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 443/918] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:22:17 2021] GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f => generated 1598 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:22:17.342208 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-937ddbc6-ac66-491e-8ceb-f7d8acb5deba tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:22:17.342711 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-937ddbc6-ac66-491e-8ceb-f7d8acb5deba tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:22:17.348476 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-937ddbc6-ac66-491e-8ceb-f7d8acb5deba tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:17.348926 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-937ddbc6-ac66-491e-8ceb-f7d8acb5deba tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:17.349708 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-937ddbc6-ac66-491e-8ceb-f7d8acb5deba tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:17.350653 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-937ddbc6-ac66-491e-8ceb-f7d8acb5deba tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:17.431152 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-937ddbc6-ac66-491e-8ceb-f7d8acb5deba tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.092498 Dec 14 03:22:17.431749 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 476/919] 10.222.0.43 () {60 vars in 1315 bytes} [Tue Dec 14 03:22:17 2021] GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 14 03:22:17.930090 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [req-fe2ee5f4-3966-499e-b896-b7bb6776fb24 req-1faaa281-04a7-4dc8-b9d6-79747101d6ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57e0aa27-4adb-426a-9236-0543142651e0", "name": "network-vif-deleted", "tag": "0a5dcf35-42a4-4fa6-a151-bf760152d86b"}]} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:22:17.932175 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:22:17.932175 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: warnings.warn(msg) Dec 14 03:22:17.939902 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [req-fe2ee5f4-3966-499e-b896-b7bb6776fb24 req-1faaa281-04a7-4dc8-b9d6-79747101d6ae service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:17.940345 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [req-fe2ee5f4-3966-499e-b896-b7bb6776fb24 req-1faaa281-04a7-4dc8-b9d6-79747101d6ae service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:17.953122 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.compute.server_external_events [req-fe2ee5f4-3966-499e-b896-b7bb6776fb24 req-1faaa281-04a7-4dc8-b9d6-79747101d6ae service nova] Creating event network-vif-deleted:0a5dcf35-42a4-4fa6-a151-bf760152d86b for instance 57e0aa27-4adb-426a-9236-0543142651e0 on hv-cinder-81803 Dec 14 03:22:17.959296 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [req-fe2ee5f4-3966-499e-b896-b7bb6776fb24 req-1faaa281-04a7-4dc8-b9d6-79747101d6ae service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033684 Dec 14 03:22:17.960336 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 444/920] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Dec 14 03:22:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:22:18.139957 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-31caaf95-0c19-45eb-9d14-c3ce3feae573 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:22:18.141360 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-31caaf95-0c19-45eb-9d14-c3ce3feae573 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] [instance: 57e0aa27-4adb-426a-9236-0543142651e0] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:22:18.148635 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-31caaf95-0c19-45eb-9d14-c3ce3feae573 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:18.149094 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-31caaf95-0c19-45eb-9d14-c3ce3feae573 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:18.149926 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-31caaf95-0c19-45eb-9d14-c3ce3feae573 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:18.150363 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-31caaf95-0c19-45eb-9d14-c3ce3feae573 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:18.183472 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-31caaf95-0c19-45eb-9d14-c3ce3feae573 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:18.183922 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-31caaf95-0c19-45eb-9d14-c3ce3feae573 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:18.184372 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.objects.instance [None req-31caaf95-0c19-45eb-9d14-c3ce3feae573 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lazy-loading 'fault' on Instance uuid 57e0aa27-4adb-426a-9236-0543142651e0 {{(pid=116072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 14 03:22:18.251439 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-31caaf95-0c19-45eb-9d14-c3ce3feae573 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bfec4b3f8b47cf93f7d07703365d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325c78a0c8574ce0bb38f768705a1181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:22:18.258547 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-31caaf95-0c19-45eb-9d14-c3ce3feae573 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /compute/v2.1/servers/57e0aa27-4adb-426a-9236-0543142651e0" status: 200 len: 1309 microversion: 2.1 time: 0.122490 Dec 14 03:22:18.259133 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 477/921] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:22:18 2021] GET /compute/v2.1/servers/57e0aa27-4adb-426a-9236-0543142651e0 => generated 1309 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:22:18.629425 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-cecd09b1-ce97-426f-b10d-e5ffc6a1e094 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:22:18.630554 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-cecd09b1-ce97-426f-b10d-e5ffc6a1e094 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:22:18.637466 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-cecd09b1-ce97-426f-b10d-e5ffc6a1e094 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:18.637977 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-cecd09b1-ce97-426f-b10d-e5ffc6a1e094 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:18.638833 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-cecd09b1-ce97-426f-b10d-e5ffc6a1e094 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:18.639369 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-cecd09b1-ce97-426f-b10d-e5ffc6a1e094 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:18.727340 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-cecd09b1-ce97-426f-b10d-e5ffc6a1e094 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action" status: 200 len: 14 microversion: 2.20 time: 0.101893 Dec 14 03:22:18.728222 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 445/922] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:22:18 2021] POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:22:18.756172 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [req-6fbfe3aa-02e4-4f49-a09e-0b34daedd05b req-4959ce78-3fc0-4fe2-b03c-58481fb2ce4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "279d5888-562c-4c6a-b27c-3f8e84fd510f", "tag": "9eee83b0-b14c-403e-a6bd-7d2515f7e214"}]} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:22:18.758296 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:22:18.758296 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: warnings.warn(msg) Dec 14 03:22:18.764978 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-6fbfe3aa-02e4-4f49-a09e-0b34daedd05b req-4959ce78-3fc0-4fe2-b03c-58481fb2ce4b service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:18.765396 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-6fbfe3aa-02e4-4f49-a09e-0b34daedd05b req-4959ce78-3fc0-4fe2-b03c-58481fb2ce4b service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:18.776298 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.compute.server_external_events [req-6fbfe3aa-02e4-4f49-a09e-0b34daedd05b req-4959ce78-3fc0-4fe2-b03c-58481fb2ce4b service nova] Creating event network-changed:9eee83b0-b14c-403e-a6bd-7d2515f7e214 for instance 279d5888-562c-4c6a-b27c-3f8e84fd510f on hv-cinder-81803 Dec 14 03:22:18.781205 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [req-6fbfe3aa-02e4-4f49-a09e-0b34daedd05b req-4959ce78-3fc0-4fe2-b03c-58481fb2ce4b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.153794 Dec 14 03:22:18.781725 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 478/923] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Dec 14 03:22:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 14 03:22:19.276248 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-88f45b3e-03b9-45bd-b639-210edb3c3080 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:22:19.276865 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-88f45b3e-03b9-45bd-b639-210edb3c3080 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] [instance: 57e0aa27-4adb-426a-9236-0543142651e0] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:22:19.283906 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-88f45b3e-03b9-45bd-b639-210edb3c3080 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:19.284603 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-88f45b3e-03b9-45bd-b639-210edb3c3080 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:19.285404 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-88f45b3e-03b9-45bd-b639-210edb3c3080 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:19.285848 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-88f45b3e-03b9-45bd-b639-210edb3c3080 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:19.299665 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.wsgi [None req-88f45b3e-03b9-45bd-b639-210edb3c3080 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] HTTP exception thrown: Instance 57e0aa27-4adb-426a-9236-0543142651e0 could not be found. Dec 14 03:22:19.300674 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-88f45b3e-03b9-45bd-b639-210edb3c3080 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] Returning 404 to user: Instance 57e0aa27-4adb-426a-9236-0543142651e0 could not be found. {{(pid=116071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 03:22:19.301732 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-88f45b3e-03b9-45bd-b639-210edb3c3080 tempest-VolumesSnapshotTestJSON-1185400409 tempest-VolumesSnapshotTestJSON-1185400409-project] 10.222.0.43 "GET /compute/v2.1/servers/57e0aa27-4adb-426a-9236-0543142651e0" status: 404 len: 111 microversion: 2.1 time: 0.029601 Dec 14 03:22:19.306180 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 446/924] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:22:19 2021] GET /compute/v2.1/servers/57e0aa27-4adb-426a-9236-0543142651e0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 14 03:22:19.739158 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-b5cc9979-bf67-4a8a-95ed-997275fd46a0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:22:19.740287 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-b5cc9979-bf67-4a8a-95ed-997275fd46a0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:22:19.746990 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b5cc9979-bf67-4a8a-95ed-997275fd46a0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:19.747548 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b5cc9979-bf67-4a8a-95ed-997275fd46a0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:19.748409 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b5cc9979-bf67-4a8a-95ed-997275fd46a0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:19.748957 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b5cc9979-bf67-4a8a-95ed-997275fd46a0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:19.827172 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-b5cc9979-bf67-4a8a-95ed-997275fd46a0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action" status: 200 len: 14 microversion: 2.20 time: 0.092690 Dec 14 03:22:19.827806 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 479/925] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:22:19 2021] POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:22:20.837699 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-65a5c90d-72ca-440c-a883-056dd08594b4 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:22:20.838624 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-65a5c90d-72ca-440c-a883-056dd08594b4 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:22:20.844926 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-65a5c90d-72ca-440c-a883-056dd08594b4 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:20.845387 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-65a5c90d-72ca-440c-a883-056dd08594b4 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:20.846167 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-65a5c90d-72ca-440c-a883-056dd08594b4 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:20.846612 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-65a5c90d-72ca-440c-a883-056dd08594b4 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:20.929412 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-65a5c90d-72ca-440c-a883-056dd08594b4 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action" status: 200 len: 14 microversion: 2.20 time: 0.095319 Dec 14 03:22:20.930024 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 447/926] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:22:20 2021] POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:22:21.940817 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-95e653e2-309b-4c09-8bfd-5c95afaa2907 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:22:21.941772 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-95e653e2-309b-4c09-8bfd-5c95afaa2907 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:22:21.949110 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-95e653e2-309b-4c09-8bfd-5c95afaa2907 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:21.949561 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-95e653e2-309b-4c09-8bfd-5c95afaa2907 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:21.950339 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-95e653e2-309b-4c09-8bfd-5c95afaa2907 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:21.950770 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-95e653e2-309b-4c09-8bfd-5c95afaa2907 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:24.775532 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-95e653e2-309b-4c09-8bfd-5c95afaa2907 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action" status: 200 len: 14 microversion: 2.20 time: 2.838634 Dec 14 03:22:24.776169 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 480/927] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:22:21 2021] POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action => generated 14 bytes in 2840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:22:25.500061 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-3d456f76-b978-441a-bbd8-2da4cfbc3117 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:22:25.501130 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-3d456f76-b978-441a-bbd8-2da4cfbc3117 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:22:25.506290 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-92a1de91-03a0-43f7-badd-826580d7e740 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-309499008"}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:22:25.507619 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-92a1de91-03a0-43f7-badd-826580d7e740 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] [instance: cfd2456c-8f28-4be0-9c97-8e03b0fec041] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:22:25.508715 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3d456f76-b978-441a-bbd8-2da4cfbc3117 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:25.509162 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3d456f76-b978-441a-bbd8-2da4cfbc3117 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:25.509943 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3d456f76-b978-441a-bbd8-2da4cfbc3117 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:25.510373 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3d456f76-b978-441a-bbd8-2da4cfbc3117 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:25.514355 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-92a1de91-03a0-43f7-badd-826580d7e740 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:25.514811 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-92a1de91-03a0-43f7-badd-826580d7e740 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:25.515629 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-92a1de91-03a0-43f7-badd-826580d7e740 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:25.516069 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-92a1de91-03a0-43f7-badd-826580d7e740 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:25.538475 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-3d456f76-b978-441a-bbd8-2da4cfbc3117 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042652 Dec 14 03:22:25.539021 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 481/928] 10.222.0.43 () {58 vars in 1301 bytes} [Tue Dec 14 03:22:25 2021] GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 14 03:22:25.592499 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-b70d5320-a3e5-42b3-ac94-e48f37bd9498 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:22:25.593003 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-b70d5320-a3e5-42b3-ac94-e48f37bd9498 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:22:25.599152 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b70d5320-a3e5-42b3-ac94-e48f37bd9498 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:25.599598 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b70d5320-a3e5-42b3-ac94-e48f37bd9498 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:25.600912 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b70d5320-a3e5-42b3-ac94-e48f37bd9498 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:25.601345 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b70d5320-a3e5-42b3-ac94-e48f37bd9498 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:25.626203 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-b70d5320-a3e5-42b3-ac94-e48f37bd9498 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Going to try to terminate instance {{(pid=116072) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 14 03:22:25.642943 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.network.security_group_api [None req-92a1de91-03a0-43f7-badd-826580d7e740 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Removing security group fa44b3d3-acb1-44ee-af7e-bffca3aa686e from port bb3c28d2-c03d-4924-8dd8-da975e5427e4 Dec 14 03:22:25.701364 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-b70d5320-a3e5-42b3-ac94-e48f37bd9498 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "DELETE /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364" status: 204 len: 0 microversion: 2.1 time: 0.111840 Dec 14 03:22:25.702316 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 482/929] 10.222.0.43 () {58 vars in 1238 bytes} [Tue Dec 14 03:22:25 2021] DELETE /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 14 03:22:25.711396 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-211d65ad-34d9-4e3f-b32e-49bcf8cb9be4 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:22:25.712557 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-211d65ad-34d9-4e3f-b32e-49bcf8cb9be4 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:22:25.719882 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-211d65ad-34d9-4e3f-b32e-49bcf8cb9be4 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:25.720329 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-211d65ad-34d9-4e3f-b32e-49bcf8cb9be4 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:25.721111 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-211d65ad-34d9-4e3f-b32e-49bcf8cb9be4 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:25.721543 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-211d65ad-34d9-4e3f-b32e-49bcf8cb9be4 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:25.955866 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-211d65ad-34d9-4e3f-b32e-49bcf8cb9be4 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107444106cda461dab7c403665d92613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:22:25.964507 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-211d65ad-34d9-4e3f-b32e-49bcf8cb9be4 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364" status: 200 len: 1672 microversion: 2.1 time: 0.257809 Dec 14 03:22:25.965092 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 483/930] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:22:25 2021] GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364 => generated 1672 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 03:22:25.969908 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-aa7f066d-6319-42e2-8543-6a700ee4ab66 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:22:25.970882 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-aa7f066d-6319-42e2-8543-6a700ee4ab66 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:22:25.977154 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-aa7f066d-6319-42e2-8543-6a700ee4ab66 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:25.977684 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-aa7f066d-6319-42e2-8543-6a700ee4ab66 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:25.978570 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-aa7f066d-6319-42e2-8543-6a700ee4ab66 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:25.979184 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-aa7f066d-6319-42e2-8543-6a700ee4ab66 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:26.058839 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-92a1de91-03a0-43f7-badd-826580d7e740 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "POST /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041/action" status: 202 len: 0 microversion: 2.1 time: 0.658557 Dec 14 03:22:26.062243 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-aa7f066d-6319-42e2-8543-6a700ee4ab66 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action" status: 200 len: 14 microversion: 2.20 time: 0.095926 Dec 14 03:22:26.062710 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 448/931] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:22:25 2021] POST /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041/action => generated 0 bytes in 663 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:22:26.063730 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 484/932] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:22:25 2021] POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action => generated 14 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:22:26.079762 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [req-cf9541c9-0770-4a3f-8f89-13e4c1f51b2f req-957c8b3d-d30f-4e4d-b96e-f0080a71333b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfd2456c-8f28-4be0-9c97-8e03b0fec041", "tag": "bb3c28d2-c03d-4924-8dd8-da975e5427e4"}]} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:22:26.081983 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:22:26.081983 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: warnings.warn(msg) Dec 14 03:22:26.107367 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [req-cf9541c9-0770-4a3f-8f89-13e4c1f51b2f req-957c8b3d-d30f-4e4d-b96e-f0080a71333b service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:26.108910 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [req-cf9541c9-0770-4a3f-8f89-13e4c1f51b2f req-957c8b3d-d30f-4e4d-b96e-f0080a71333b service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:26.133361 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.compute.server_external_events [req-cf9541c9-0770-4a3f-8f89-13e4c1f51b2f req-957c8b3d-d30f-4e4d-b96e-f0080a71333b service nova] Creating event network-changed:bb3c28d2-c03d-4924-8dd8-da975e5427e4 for instance cfd2456c-8f28-4be0-9c97-8e03b0fec041 on hv-cinder-81803 Dec 14 03:22:26.144597 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [req-cf9541c9-0770-4a3f-8f89-13e4c1f51b2f req-957c8b3d-d30f-4e4d-b96e-f0080a71333b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070027 Dec 14 03:22:26.147407 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 449/933] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Dec 14 03:22:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 14 03:22:26.981969 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-7a382dbd-d6dc-4870-a82f-f7ab5c61e585 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:22:26.982939 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-7a382dbd-d6dc-4870-a82f-f7ab5c61e585 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:22:26.990184 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7a382dbd-d6dc-4870-a82f-f7ab5c61e585 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:26.991264 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7a382dbd-d6dc-4870-a82f-f7ab5c61e585 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:26.992066 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7a382dbd-d6dc-4870-a82f-f7ab5c61e585 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:26.992503 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7a382dbd-d6dc-4870-a82f-f7ab5c61e585 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:27.074891 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-c7e82f3c-0659-4927-b35a-5dd25dec5003 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:22:27.075862 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-c7e82f3c-0659-4927-b35a-5dd25dec5003 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:22:27.081996 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c7e82f3c-0659-4927-b35a-5dd25dec5003 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:27.082668 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c7e82f3c-0659-4927-b35a-5dd25dec5003 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:27.083656 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c7e82f3c-0659-4927-b35a-5dd25dec5003 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:27.084317 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c7e82f3c-0659-4927-b35a-5dd25dec5003 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:27.134826 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-7a382dbd-d6dc-4870-a82f-f7ab5c61e585 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107444106cda461dab7c403665d92613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:22:27.142461 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-7a382dbd-d6dc-4870-a82f-f7ab5c61e585 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364" status: 200 len: 1672 microversion: 2.1 time: 0.164526 Dec 14 03:22:27.143018 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 485/934] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:22:26 2021] GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364 => generated 1672 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:22:27.270788 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-c7e82f3c-0659-4927-b35a-5dd25dec5003 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action" status: 200 len: 14 microversion: 2.20 time: 0.200565 Dec 14 03:22:27.274564 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 450/935] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:22:27 2021] POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action => generated 14 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 03:22:27.532112 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-1a50d80f-264b-4c7c-992d-a6b49f4cd376 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:22:27.532884 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-1a50d80f-264b-4c7c-992d-a6b49f4cd376 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] [instance: cfd2456c-8f28-4be0-9c97-8e03b0fec041] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:22:27.540027 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [req-e42b1104-7e8c-4f91-bbb4-4c9070880992 req-c5787124-db7b-48d8-b3b1-4e3fdd914122 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfd2456c-8f28-4be0-9c97-8e03b0fec041", "tag": "bb3c28d2-c03d-4924-8dd8-da975e5427e4"}]} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:22:27.540288 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1a50d80f-264b-4c7c-992d-a6b49f4cd376 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:27.540749 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1a50d80f-264b-4c7c-992d-a6b49f4cd376 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:27.541507 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:22:27.541507 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: warnings.warn(msg) Dec 14 03:22:27.541735 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1a50d80f-264b-4c7c-992d-a6b49f4cd376 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:27.542257 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1a50d80f-264b-4c7c-992d-a6b49f4cd376 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:27.549077 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [req-e42b1104-7e8c-4f91-bbb4-4c9070880992 req-c5787124-db7b-48d8-b3b1-4e3fdd914122 service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:27.549772 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [req-e42b1104-7e8c-4f91-bbb4-4c9070880992 req-c5787124-db7b-48d8-b3b1-4e3fdd914122 service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:27.561859 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.compute.server_external_events [req-e42b1104-7e8c-4f91-bbb4-4c9070880992 req-c5787124-db7b-48d8-b3b1-4e3fdd914122 service nova] Creating event network-changed:bb3c28d2-c03d-4924-8dd8-da975e5427e4 for instance cfd2456c-8f28-4be0-9c97-8e03b0fec041 on hv-cinder-81803 Dec 14 03:22:27.566897 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [req-e42b1104-7e8c-4f91-bbb4-4c9070880992 req-c5787124-db7b-48d8-b3b1-4e3fdd914122 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030695 Dec 14 03:22:27.567540 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 451/936] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Dec 14 03:22:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:22:27.633045 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.objects.instance [None req-1a50d80f-264b-4c7c-992d-a6b49f4cd376 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lazy-loading 'services' on Instance uuid cfd2456c-8f28-4be0-9c97-8e03b0fec041 {{(pid=116072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 14 03:22:27.717685 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-1a50d80f-264b-4c7c-992d-a6b49f4cd376 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "DELETE /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041/os-volume_attachments/dc386862-c00f-4e23-95dc-baf94c91b9a7" status: 202 len: 0 microversion: 2.1 time: 0.189216 Dec 14 03:22:27.718763 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 486/937] 10.222.0.43 () {58 vars in 1415 bytes} [Tue Dec 14 03:22:27 2021] DELETE /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041/os-volume_attachments/dc386862-c00f-4e23-95dc-baf94c91b9a7 => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:22:27.729090 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-7c69f555-ba1e-46a1-bbfa-e97dac09c680 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:22:27.730370 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-7c69f555-ba1e-46a1-bbfa-e97dac09c680 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] [instance: cfd2456c-8f28-4be0-9c97-8e03b0fec041] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:22:27.736885 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-7c69f555-ba1e-46a1-bbfa-e97dac09c680 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:27.737863 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-7c69f555-ba1e-46a1-bbfa-e97dac09c680 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:27.738854 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-7c69f555-ba1e-46a1-bbfa-e97dac09c680 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:27.739326 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-7c69f555-ba1e-46a1-bbfa-e97dac09c680 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:27.775567 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-7c69f555-ba1e-46a1-bbfa-e97dac09c680 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051965 Dec 14 03:22:27.776841 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 452/938] 10.222.0.43 () {58 vars in 1301 bytes} [Tue Dec 14 03:22:27 2021] GET /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:22:28.159910 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-97b142a4-912a-4812-804c-3f4bdc0801ca tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:22:28.160611 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-97b142a4-912a-4812-804c-3f4bdc0801ca tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:22:28.168405 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-97b142a4-912a-4812-804c-3f4bdc0801ca tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:28.169294 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-97b142a4-912a-4812-804c-3f4bdc0801ca tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:28.170266 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-97b142a4-912a-4812-804c-3f4bdc0801ca tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:28.170869 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-97b142a4-912a-4812-804c-3f4bdc0801ca tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:28.281994 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-909d62e0-675f-4a25-8e80-f5b8e27c1a6d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:22:28.282923 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-909d62e0-675f-4a25-8e80-f5b8e27c1a6d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:22:28.289197 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-909d62e0-675f-4a25-8e80-f5b8e27c1a6d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:28.289655 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-909d62e0-675f-4a25-8e80-f5b8e27c1a6d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:28.290442 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-909d62e0-675f-4a25-8e80-f5b8e27c1a6d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:28.290886 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-909d62e0-675f-4a25-8e80-f5b8e27c1a6d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:28.385852 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-909d62e0-675f-4a25-8e80-f5b8e27c1a6d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action" status: 200 len: 14 microversion: 2.20 time: 0.107338 Dec 14 03:22:28.389102 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 453/939] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:22:28 2021] POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action => generated 14 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 03:22:28.446230 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-97b142a4-912a-4812-804c-3f4bdc0801ca tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107444106cda461dab7c403665d92613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:22:28.454428 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-97b142a4-912a-4812-804c-3f4bdc0801ca tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364" status: 200 len: 1672 microversion: 2.1 time: 0.298474 Dec 14 03:22:28.454992 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 487/940] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:22:28 2021] GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364 => generated 1672 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:22:28.790187 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-045426f5-90b1-47a0-9fac-b3dd9ba6b5c2 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:22:28.792187 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-045426f5-90b1-47a0-9fac-b3dd9ba6b5c2 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] [instance: cfd2456c-8f28-4be0-9c97-8e03b0fec041] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:22:28.800511 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-045426f5-90b1-47a0-9fac-b3dd9ba6b5c2 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:28.801371 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-045426f5-90b1-47a0-9fac-b3dd9ba6b5c2 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:28.802525 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-045426f5-90b1-47a0-9fac-b3dd9ba6b5c2 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:28.803691 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-045426f5-90b1-47a0-9fac-b3dd9ba6b5c2 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:28.836805 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-045426f5-90b1-47a0-9fac-b3dd9ba6b5c2 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052030 Dec 14 03:22:28.837472 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 454/941] 10.222.0.43 () {58 vars in 1301 bytes} [Tue Dec 14 03:22:28 2021] GET /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 14 03:22:28.847710 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-906e9ea2-659e-404e-a5a9-20dd9ec0d587 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:22:28.848469 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-906e9ea2-659e-404e-a5a9-20dd9ec0d587 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] [instance: cfd2456c-8f28-4be0-9c97-8e03b0fec041] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:22:28.855810 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-906e9ea2-659e-404e-a5a9-20dd9ec0d587 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:28.856266 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-906e9ea2-659e-404e-a5a9-20dd9ec0d587 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:28.857088 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-906e9ea2-659e-404e-a5a9-20dd9ec0d587 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:28.857523 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-906e9ea2-659e-404e-a5a9-20dd9ec0d587 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:28.952575 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.wsgi [None req-906e9ea2-659e-404e-a5a9-20dd9ec0d587 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] HTTP exception thrown: Instance cfd2456c-8f28-4be0-9c97-8e03b0fec041 is not attached to volume dc386862-c00f-4e23-95dc-baf94c91b9a7 Dec 14 03:22:28.953326 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-906e9ea2-659e-404e-a5a9-20dd9ec0d587 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Returning 404 to user: Instance cfd2456c-8f28-4be0-9c97-8e03b0fec041 is not attached to volume dc386862-c00f-4e23-95dc-baf94c91b9a7 {{(pid=116072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 03:22:28.954311 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-906e9ea2-659e-404e-a5a9-20dd9ec0d587 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "DELETE /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041/os-volume_attachments/dc386862-c00f-4e23-95dc-baf94c91b9a7" status: 404 len: 154 microversion: 2.1 time: 0.110579 Dec 14 03:22:28.958594 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 488/942] 10.222.0.43 () {58 vars in 1415 bytes} [Tue Dec 14 03:22:28 2021] DELETE /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041/os-volume_attachments/dc386862-c00f-4e23-95dc-baf94c91b9a7 => generated 154 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 14 03:22:29.005581 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [req-850ee0fe-ae44-4f8a-ba2c-768d95ec3d16 req-9ae3bcc0-5311-4c6f-b4c8-0be097f0e972 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd35b83c-0304-43fc-85ec-731c395d3364", "name": "network-vif-deleted", "tag": "b1d9bd41-b159-47f7-8b8c-3145159e82db"}]} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:22:29.008463 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:22:29.008463 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: warnings.warn(msg) Dec 14 03:22:29.016240 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [req-850ee0fe-ae44-4f8a-ba2c-768d95ec3d16 req-9ae3bcc0-5311-4c6f-b4c8-0be097f0e972 service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:29.016960 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [req-850ee0fe-ae44-4f8a-ba2c-768d95ec3d16 req-9ae3bcc0-5311-4c6f-b4c8-0be097f0e972 service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:29.030490 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.compute.server_external_events [req-850ee0fe-ae44-4f8a-ba2c-768d95ec3d16 req-9ae3bcc0-5311-4c6f-b4c8-0be097f0e972 service nova] Creating event network-vif-deleted:b1d9bd41-b159-47f7-8b8c-3145159e82db for instance fd35b83c-0304-43fc-85ec-731c395d3364 on hv-cinder-81803 Dec 14 03:22:29.043397 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [req-850ee0fe-ae44-4f8a-ba2c-768d95ec3d16 req-9ae3bcc0-5311-4c6f-b4c8-0be097f0e972 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036119 Dec 14 03:22:29.044456 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 455/943] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Dec 14 03:22:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:22:29.397734 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-135e88c9-cae4-4558-a7fb-9d618e3b7309 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:22:29.398713 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-135e88c9-cae4-4558-a7fb-9d618e3b7309 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:22:29.404574 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-135e88c9-cae4-4558-a7fb-9d618e3b7309 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:29.405072 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-135e88c9-cae4-4558-a7fb-9d618e3b7309 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:29.405803 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-135e88c9-cae4-4558-a7fb-9d618e3b7309 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:29.406244 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-135e88c9-cae4-4558-a7fb-9d618e3b7309 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:29.472316 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-c641f2e3-b2b5-4694-8a12-e557eb6a1c58 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:22:29.473305 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-c641f2e3-b2b5-4694-8a12-e557eb6a1c58 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:22:29.479383 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c641f2e3-b2b5-4694-8a12-e557eb6a1c58 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:29.479846 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c641f2e3-b2b5-4694-8a12-e557eb6a1c58 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:29.480636 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c641f2e3-b2b5-4694-8a12-e557eb6a1c58 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:29.481068 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c641f2e3-b2b5-4694-8a12-e557eb6a1c58 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:29.512036 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c641f2e3-b2b5-4694-8a12-e557eb6a1c58 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:29.512489 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c641f2e3-b2b5-4694-8a12-e557eb6a1c58 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:29.512936 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.objects.instance [None req-c641f2e3-b2b5-4694-8a12-e557eb6a1c58 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lazy-loading 'fault' on Instance uuid fd35b83c-0304-43fc-85ec-731c395d3364 {{(pid=116071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 14 03:22:29.517038 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-135e88c9-cae4-4558-a7fb-9d618e3b7309 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action" status: 200 len: 6451 microversion: 2.20 time: 0.123673 Dec 14 03:22:29.517881 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 489/944] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:22:29 2021] POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action => generated 6451 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 14 03:22:29.554322 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-c641f2e3-b2b5-4694-8a12-e557eb6a1c58 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107444106cda461dab7c403665d92613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:22:29.562516 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-c641f2e3-b2b5-4694-8a12-e557eb6a1c58 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364" status: 200 len: 1326 microversion: 2.1 time: 0.094383 Dec 14 03:22:29.563321 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 456/945] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:22:29 2021] GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364 => generated 1326 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 03:22:30.122595 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-176be8fd-22fd-455b-ba43-cd6f10829988 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:22:30.123228 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-176be8fd-22fd-455b-ba43-cd6f10829988 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] [instance: cfd2456c-8f28-4be0-9c97-8e03b0fec041] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:22:30.130502 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-176be8fd-22fd-455b-ba43-cd6f10829988 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:30.131514 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-176be8fd-22fd-455b-ba43-cd6f10829988 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:30.132308 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-176be8fd-22fd-455b-ba43-cd6f10829988 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:30.132745 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-176be8fd-22fd-455b-ba43-cd6f10829988 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:30.158324 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-176be8fd-22fd-455b-ba43-cd6f10829988 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] [instance: cfd2456c-8f28-4be0-9c97-8e03b0fec041] Going to try to terminate instance {{(pid=116072) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 14 03:22:30.229332 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-176be8fd-22fd-455b-ba43-cd6f10829988 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "DELETE /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041" status: 204 len: 0 microversion: 2.1 time: 0.110470 Dec 14 03:22:30.229855 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 490/946] 10.222.0.43 () {58 vars in 1238 bytes} [Tue Dec 14 03:22:30 2021] DELETE /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 14 03:22:30.237983 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-176dbe60-de52-437a-aba7-4cbb2c0a5fa2 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:22:30.238632 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-176dbe60-de52-437a-aba7-4cbb2c0a5fa2 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] [instance: cfd2456c-8f28-4be0-9c97-8e03b0fec041] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:22:30.244922 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-176dbe60-de52-437a-aba7-4cbb2c0a5fa2 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:30.245380 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-176dbe60-de52-437a-aba7-4cbb2c0a5fa2 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:30.246156 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-176dbe60-de52-437a-aba7-4cbb2c0a5fa2 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:30.246596 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-176dbe60-de52-437a-aba7-4cbb2c0a5fa2 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:30.371618 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-176dbe60-de52-437a-aba7-4cbb2c0a5fa2 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d620fa9da54f588f753b3c497f00c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:22:30.378832 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-176dbe60-de52-437a-aba7-4cbb2c0a5fa2 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041" status: 200 len: 1555 microversion: 2.1 time: 0.144718 Dec 14 03:22:30.379413 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 457/947] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:22:30 2021] GET /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041 => generated 1555 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:22:30.528187 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-d5838ad3-fd9d-4294-8bbb-810479e19a65 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:22:30.529109 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-d5838ad3-fd9d-4294-8bbb-810479e19a65 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:22:30.538021 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d5838ad3-fd9d-4294-8bbb-810479e19a65 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:30.538471 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d5838ad3-fd9d-4294-8bbb-810479e19a65 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:30.539278 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d5838ad3-fd9d-4294-8bbb-810479e19a65 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:30.539718 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d5838ad3-fd9d-4294-8bbb-810479e19a65 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:30.579830 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-d5e26cfd-c5ab-4857-b913-b323c05ef619 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:22:30.580440 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-d5e26cfd-c5ab-4857-b913-b323c05ef619 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:22:30.586819 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-d5e26cfd-c5ab-4857-b913-b323c05ef619 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:30.587310 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-d5e26cfd-c5ab-4857-b913-b323c05ef619 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:30.588123 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-d5e26cfd-c5ab-4857-b913-b323c05ef619 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:30.588588 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-d5e26cfd-c5ab-4857-b913-b323c05ef619 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:30.601536 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.wsgi [None req-d5e26cfd-c5ab-4857-b913-b323c05ef619 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] HTTP exception thrown: Instance fd35b83c-0304-43fc-85ec-731c395d3364 could not be found. Dec 14 03:22:30.602114 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-d5e26cfd-c5ab-4857-b913-b323c05ef619 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Returning 404 to user: Instance fd35b83c-0304-43fc-85ec-731c395d3364 could not be found. {{(pid=116071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 03:22:30.602949 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-d5e26cfd-c5ab-4857-b913-b323c05ef619 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364" status: 404 len: 111 microversion: 2.1 time: 0.026804 Dec 14 03:22:30.603494 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 458/948] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:22:30 2021] GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 14 03:22:30.610849 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-9d5c56ac-fa8a-4bd1-997e-01217e4382cf tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '.version_select at 0x7fa50368a4c0>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:22:30.628852 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-9d5c56ac-fa8a-4bd1-997e-01217e4382cf tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-81813335" status: 202 len: 0 microversion: 2.1 time: 0.021109 Dec 14 03:22:30.629382 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 459/949] 10.222.0.43 () {58 vars in 1214 bytes} [Tue Dec 14 03:22:30 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-81813335 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 14 03:22:31.269275 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-7302c967-6881-4bb0-99ca-3a9db51c6c0d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'create', calling method: .version_select at 0x7fa5036ceb80>, body: {"keypair": {"name": "tempest-keypair-2041604421"}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:22:31.283975 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.quota [None req-7302c967-6881-4bb0-99ca-3a9db51c6c0d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Getting quotas for project 11634c00674445cb81d9dabfbcc791a8. Resources: {'key_pairs'} {{(pid=116071) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 03:22:31.288357 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.quota [None req-7302c967-6881-4bb0-99ca-3a9db51c6c0d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Getting quotas for user 107444106cda461dab7c403665d92613 and project 11634c00674445cb81d9dabfbcc791a8. Resources: {'key_pairs'} {{(pid=116071) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 03:22:31.697891 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.quota [None req-7302c967-6881-4bb0-99ca-3a9db51c6c0d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Getting quotas for project 11634c00674445cb81d9dabfbcc791a8. Resources: {'key_pairs'} {{(pid=116071) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 03:22:31.701903 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.quota [None req-7302c967-6881-4bb0-99ca-3a9db51c6c0d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Getting quotas for user 107444106cda461dab7c403665d92613 and project 11634c00674445cb81d9dabfbcc791a8. Resources: {'key_pairs'} {{(pid=116071) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 03:22:31.715166 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-7302c967-6881-4bb0-99ca-3a9db51c6c0d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.449983 Dec 14 03:22:31.715753 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 460/950] 10.222.0.43 () {60 vars in 1157 bytes} [Tue Dec 14 03:22:31 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 03:22:31.720977 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-159cdfae-6b00-4e24-bb71-01ab030da24d tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:22:31.721611 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-159cdfae-6b00-4e24-bb71-01ab030da24d tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] [instance: cfd2456c-8f28-4be0-9c97-8e03b0fec041] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:22:31.727473 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-159cdfae-6b00-4e24-bb71-01ab030da24d tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:31.727936 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-159cdfae-6b00-4e24-bb71-01ab030da24d tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:31.728732 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-159cdfae-6b00-4e24-bb71-01ab030da24d tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:31.729184 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-159cdfae-6b00-4e24-bb71-01ab030da24d tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:31.874757 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-159cdfae-6b00-4e24-bb71-01ab030da24d tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d620fa9da54f588f753b3c497f00c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:22:31.882742 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-159cdfae-6b00-4e24-bb71-01ab030da24d tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041" status: 200 len: 1555 microversion: 2.1 time: 0.165239 Dec 14 03:22:31.883389 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 461/951] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:22:31 2021] GET /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041 => generated 1555 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:22:32.900215 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-0279fc7a-c39d-4556-931d-312d27c8d1c8 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:22:32.900848 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-0279fc7a-c39d-4556-931d-312d27c8d1c8 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] [instance: cfd2456c-8f28-4be0-9c97-8e03b0fec041] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:22:32.907152 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-0279fc7a-c39d-4556-931d-312d27c8d1c8 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:32.907610 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-0279fc7a-c39d-4556-931d-312d27c8d1c8 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:32.908400 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-0279fc7a-c39d-4556-931d-312d27c8d1c8 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:32.908831 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-0279fc7a-c39d-4556-931d-312d27c8d1c8 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:33.038089 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-0279fc7a-c39d-4556-931d-312d27c8d1c8 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d620fa9da54f588f753b3c497f00c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:22:33.045632 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-0279fc7a-c39d-4556-931d-312d27c8d1c8 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041" status: 200 len: 1555 microversion: 2.1 time: 0.149000 Dec 14 03:22:33.046194 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 462/952] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:22:32 2021] GET /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041 => generated 1555 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 03:22:33.051858 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-0cca9534-332e-49c8-ba84-c603e38142bf tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-455142951", "imageRef": "4fff76a9-6620-4bda-b1ec-2cd3719c946a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7e397d2e-d5ba-40c3-8051-57991a288ab3"}], "security_groups": [{"name": "tempest-securitygroup--976752068"}], "key_name": "tempest-keypair-2041604421", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:22:33.147913 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.network.neutron [None req-0cca9534-332e-49c8-ba84-c603e38142bf tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] validate_networks() for [('7e397d2e-d5ba-40c3-8051-57991a288ab3', None, None, None, None, None)] {{(pid=116071) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 14 03:22:33.585352 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.virt.hardware [None req-0cca9534-332e-49c8-ba84-c603e38142bf tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Flavor limits 0:0:0 {{(pid=116071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 14 03:22:33.585780 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.virt.hardware [None req-0cca9534-332e-49c8-ba84-c603e38142bf tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Image limits 0:0:0 {{(pid=116071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 14 03:22:33.586250 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.virt.hardware [None req-0cca9534-332e-49c8-ba84-c603e38142bf tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Flavor pref 0:0:0 {{(pid=116071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 14 03:22:33.586655 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.virt.hardware [None req-0cca9534-332e-49c8-ba84-c603e38142bf tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Image pref 0:0:0 {{(pid=116071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 14 03:22:33.587079 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.virt.hardware [None req-0cca9534-332e-49c8-ba84-c603e38142bf tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 14 03:22:33.596175 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-0cca9534-332e-49c8-ba84-c603e38142bf tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:33.596625 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-0cca9534-332e-49c8-ba84-c603e38142bf tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:33.597438 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-0cca9534-332e-49c8-ba84-c603e38142bf tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:33.597870 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-0cca9534-332e-49c8-ba84-c603e38142bf tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:33.613804 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.quota [None req-0cca9534-332e-49c8-ba84-c603e38142bf tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Getting quotas for project 11634c00674445cb81d9dabfbcc791a8. Resources: {'cores', 'instances', 'ram'} {{(pid=116071) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 03:22:33.618134 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.quota [None req-0cca9534-332e-49c8-ba84-c603e38142bf tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Getting quotas for user 107444106cda461dab7c403665d92613 and project 11634c00674445cb81d9dabfbcc791a8. Resources: {'cores', 'instances', 'ram'} {{(pid=116071) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 03:22:33.628598 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-0cca9534-332e-49c8-ba84-c603e38142bf tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Going to run 1 instances... {{(pid=116071) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 14 03:22:33.631444 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-0cca9534-332e-49c8-ba84-c603e38142bf tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4fff76a9-6620-4bda-b1ec-2cd3719c946a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 14 03:22:33.677003 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-0cca9534-332e-49c8-ba84-c603e38142bf tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.628641 Dec 14 03:22:33.678177 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 463/953] 10.222.0.43 () {60 vars in 1146 bytes} [Tue Dec 14 03:22:33 2021] POST /compute/v2.1/servers => generated 401 bytes in 631 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 14 03:22:33.687523 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-67692ee9-aa1d-436a-acaa-eb9e25b9d57b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:22:33.688127 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-67692ee9-aa1d-436a-acaa-eb9e25b9d57b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:22:33.739897 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-67692ee9-aa1d-436a-acaa-eb9e25b9d57b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107444106cda461dab7c403665d92613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:22:33.747022 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-67692ee9-aa1d-436a-acaa-eb9e25b9d57b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9" status: 200 len: 1237 microversion: 2.1 time: 0.062863 Dec 14 03:22:33.747606 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 464/954] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:22:33 2021] GET /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9 => generated 1237 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 03:22:34.063448 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-03f33e85-57f6-4d40-b693-3f18bc354657 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:22:34.064095 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-03f33e85-57f6-4d40-b693-3f18bc354657 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] [instance: cfd2456c-8f28-4be0-9c97-8e03b0fec041] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:22:34.071421 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-03f33e85-57f6-4d40-b693-3f18bc354657 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:34.072019 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-03f33e85-57f6-4d40-b693-3f18bc354657 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:34.072833 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-03f33e85-57f6-4d40-b693-3f18bc354657 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:34.073278 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-03f33e85-57f6-4d40-b693-3f18bc354657 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:34.198176 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-03f33e85-57f6-4d40-b693-3f18bc354657 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d620fa9da54f588f753b3c497f00c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:22:34.205501 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-03f33e85-57f6-4d40-b693-3f18bc354657 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041" status: 200 len: 1555 microversion: 2.1 time: 0.145842 Dec 14 03:22:34.206064 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 465/955] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:22:34 2021] GET /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041 => generated 1555 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 03:22:34.416453 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-d5838ad3-fd9d-4294-8bbb-810479e19a65 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action" status: 200 len: 22841 microversion: 2.20 time: 3.892189 Dec 14 03:22:34.417740 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 491/956] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:22:30 2021] POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action => generated 22841 bytes in 3894 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:22:34.763827 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-68352ff7-25d6-43ce-8769-fa13e0a75670 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:22:34.764351 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-68352ff7-25d6-43ce-8769-fa13e0a75670 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:22:34.770273 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-68352ff7-25d6-43ce-8769-fa13e0a75670 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:34.770729 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-68352ff7-25d6-43ce-8769-fa13e0a75670 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:34.771536 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-68352ff7-25d6-43ce-8769-fa13e0a75670 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:34.771977 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-68352ff7-25d6-43ce-8769-fa13e0a75670 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:35.043150 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-68352ff7-25d6-43ce-8769-fa13e0a75670 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107444106cda461dab7c403665d92613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:22:35.050410 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-68352ff7-25d6-43ce-8769-fa13e0a75670 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9" status: 200 len: 1289 microversion: 2.1 time: 0.290376 Dec 14 03:22:35.050969 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 466/957] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:22:34 2021] GET /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9 => generated 1289 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:22:35.222345 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-732bf706-be64-4f72-b6ce-85fbb5e42d67 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:22:35.223067 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-732bf706-be64-4f72-b6ce-85fbb5e42d67 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] [instance: cfd2456c-8f28-4be0-9c97-8e03b0fec041] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:22:35.229977 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-732bf706-be64-4f72-b6ce-85fbb5e42d67 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:35.230434 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-732bf706-be64-4f72-b6ce-85fbb5e42d67 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:35.231245 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-732bf706-be64-4f72-b6ce-85fbb5e42d67 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:35.231692 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-732bf706-be64-4f72-b6ce-85fbb5e42d67 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:35.428645 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-2dfbd164-dd4c-4a95-b4d3-8f10aa93b05c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:22:35.431070 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-2dfbd164-dd4c-4a95-b4d3-8f10aa93b05c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:22:35.432764 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-732bf706-be64-4f72-b6ce-85fbb5e42d67 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d620fa9da54f588f753b3c497f00c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:22:35.439751 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-2dfbd164-dd4c-4a95-b4d3-8f10aa93b05c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:35.440921 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-2dfbd164-dd4c-4a95-b4d3-8f10aa93b05c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:35.442061 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-2dfbd164-dd4c-4a95-b4d3-8f10aa93b05c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:35.444392 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-2dfbd164-dd4c-4a95-b4d3-8f10aa93b05c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:35.446611 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-732bf706-be64-4f72-b6ce-85fbb5e42d67 tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041" status: 200 len: 1555 microversion: 2.1 time: 0.228196 Dec 14 03:22:35.447668 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 492/958] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:22:35 2021] GET /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041 => generated 1555 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:22:35.604383 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-2dfbd164-dd4c-4a95-b4d3-8f10aa93b05c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action" status: 200 len: 23995 microversion: 2.20 time: 0.180462 Dec 14 03:22:35.605289 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 467/959] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:22:35 2021] POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action => generated 23995 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 14 03:22:36.067067 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-97d6195c-c969-4014-ab7e-1cf435a811cd tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:22:36.068325 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-97d6195c-c969-4014-ab7e-1cf435a811cd tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:22:36.074423 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-97d6195c-c969-4014-ab7e-1cf435a811cd tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:36.074878 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-97d6195c-c969-4014-ab7e-1cf435a811cd tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:36.075699 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-97d6195c-c969-4014-ab7e-1cf435a811cd tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:36.076137 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-97d6195c-c969-4014-ab7e-1cf435a811cd tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:36.295763 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-97d6195c-c969-4014-ab7e-1cf435a811cd tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107444106cda461dab7c403665d92613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:22:36.305048 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-97d6195c-c969-4014-ab7e-1cf435a811cd tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9" status: 200 len: 1362 microversion: 2.1 time: 0.241575 Dec 14 03:22:36.305629 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 493/960] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:22:36 2021] GET /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9 => generated 1362 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:22:36.464610 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-53d7dab5-00c3-495f-af9b-6c572a4df71e tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:22:36.465222 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-53d7dab5-00c3-495f-af9b-6c572a4df71e tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] [instance: cfd2456c-8f28-4be0-9c97-8e03b0fec041] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:22:36.472036 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-53d7dab5-00c3-495f-af9b-6c572a4df71e tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:36.472576 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-53d7dab5-00c3-495f-af9b-6c572a4df71e tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:36.473377 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-53d7dab5-00c3-495f-af9b-6c572a4df71e tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:36.473826 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-53d7dab5-00c3-495f-af9b-6c572a4df71e tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:36.616558 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-90e6a389-e3c1-462f-8b4a-7b18c698cf1a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:22:36.623445 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-90e6a389-e3c1-462f-8b4a-7b18c698cf1a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:22:36.629803 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-90e6a389-e3c1-462f-8b4a-7b18c698cf1a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:36.630454 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-90e6a389-e3c1-462f-8b4a-7b18c698cf1a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:36.631457 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-90e6a389-e3c1-462f-8b4a-7b18c698cf1a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:36.632560 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-90e6a389-e3c1-462f-8b4a-7b18c698cf1a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:36.712328 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-53d7dab5-00c3-495f-af9b-6c572a4df71e tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d620fa9da54f588f753b3c497f00c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:22:36.731033 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-53d7dab5-00c3-495f-af9b-6c572a4df71e tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041" status: 200 len: 1555 microversion: 2.1 time: 0.270551 Dec 14 03:22:36.731794 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 468/961] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:22:36 2021] GET /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041 => generated 1555 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:22:36.777597 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-90e6a389-e3c1-462f-8b4a-7b18c698cf1a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action" status: 200 len: 25676 microversion: 2.20 time: 0.164875 Dec 14 03:22:36.778436 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 494/962] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:22:36 2021] POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action => generated 25676 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:22:36.950505 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [req-94dd2243-a278-4532-85c7-5b3ef12746b6 req-63a14555-64ce-4b29-b68e-3374bf6fdd3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f227308f-4d44-4197-9dfd-ddf690c0c0f9", "tag": "cf2ca0eb-9e28-4a89-8062-525c1792d08a"}]} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:22:36.951979 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:22:36.951979 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: warnings.warn(msg) Dec 14 03:22:36.960513 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [req-94dd2243-a278-4532-85c7-5b3ef12746b6 req-63a14555-64ce-4b29-b68e-3374bf6fdd3d service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:36.961024 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [req-94dd2243-a278-4532-85c7-5b3ef12746b6 req-63a14555-64ce-4b29-b68e-3374bf6fdd3d service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:36.974173 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.compute.server_external_events [req-94dd2243-a278-4532-85c7-5b3ef12746b6 req-63a14555-64ce-4b29-b68e-3374bf6fdd3d service nova] Creating event network-changed:cf2ca0eb-9e28-4a89-8062-525c1792d08a for instance f227308f-4d44-4197-9dfd-ddf690c0c0f9 on hv-cinder-81803 Dec 14 03:22:36.980586 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [req-94dd2243-a278-4532-85c7-5b3ef12746b6 req-63a14555-64ce-4b29-b68e-3374bf6fdd3d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033825 Dec 14 03:22:36.981190 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 469/963] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Dec 14 03:22:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:22:37.322936 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-5adb09e5-0825-4ab8-b834-eae0221cdd98 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:22:37.323662 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-5adb09e5-0825-4ab8-b834-eae0221cdd98 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:22:37.330473 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5adb09e5-0825-4ab8-b834-eae0221cdd98 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:37.330930 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5adb09e5-0825-4ab8-b834-eae0221cdd98 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:37.331750 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5adb09e5-0825-4ab8-b834-eae0221cdd98 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:37.332187 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5adb09e5-0825-4ab8-b834-eae0221cdd98 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:37.548529 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-5adb09e5-0825-4ab8-b834-eae0221cdd98 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107444106cda461dab7c403665d92613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:22:37.556695 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-5adb09e5-0825-4ab8-b834-eae0221cdd98 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9" status: 200 len: 1362 microversion: 2.1 time: 0.238486 Dec 14 03:22:37.557262 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 495/964] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:22:37 2021] GET /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9 => generated 1362 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:22:37.750579 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-8c5d4020-a36c-42c7-9c8b-28decdcb1dbc tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:22:37.751345 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-8c5d4020-a36c-42c7-9c8b-28decdcb1dbc tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] [instance: cfd2456c-8f28-4be0-9c97-8e03b0fec041] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:22:37.757391 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-8c5d4020-a36c-42c7-9c8b-28decdcb1dbc tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:37.757837 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-8c5d4020-a36c-42c7-9c8b-28decdcb1dbc tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:37.759091 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-8c5d4020-a36c-42c7-9c8b-28decdcb1dbc tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:37.759722 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-8c5d4020-a36c-42c7-9c8b-28decdcb1dbc tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:37.791176 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-8c5d4020-a36c-42c7-9c8b-28decdcb1dbc tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:37.791391 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-e21ec684-ec39-4a0d-ad33-37d3e8444804 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:22:37.791870 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-8c5d4020-a36c-42c7-9c8b-28decdcb1dbc tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:37.792073 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.objects.instance [None req-8c5d4020-a36c-42c7-9c8b-28decdcb1dbc tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lazy-loading 'fault' on Instance uuid cfd2456c-8f28-4be0-9c97-8e03b0fec041 {{(pid=116071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 14 03:22:37.792373 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-e21ec684-ec39-4a0d-ad33-37d3e8444804 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:22:37.798724 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e21ec684-ec39-4a0d-ad33-37d3e8444804 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:37.799206 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e21ec684-ec39-4a0d-ad33-37d3e8444804 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:37.800018 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e21ec684-ec39-4a0d-ad33-37d3e8444804 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:37.800567 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e21ec684-ec39-4a0d-ad33-37d3e8444804 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:37.839759 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-8c5d4020-a36c-42c7-9c8b-28decdcb1dbc tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d620fa9da54f588f753b3c497f00c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc2e5ee76edf4e358f418773bf824ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:22:37.847210 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-8c5d4020-a36c-42c7-9c8b-28decdcb1dbc tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041" status: 200 len: 1349 microversion: 2.1 time: 0.101163 Dec 14 03:22:37.847777 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 470/965] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:22:37 2021] GET /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041 => generated 1349 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:22:37.919484 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-e21ec684-ec39-4a0d-ad33-37d3e8444804 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action" status: 200 len: 26912 microversion: 2.20 time: 0.133284 Dec 14 03:22:37.920132 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 496/966] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:22:37 2021] POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action => generated 26912 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 14 03:22:38.575672 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-0c802f17-faff-498a-9ed3-50a9cad6ecdf tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:22:38.576661 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-0c802f17-faff-498a-9ed3-50a9cad6ecdf tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:22:38.585905 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-0c802f17-faff-498a-9ed3-50a9cad6ecdf tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:38.586373 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-0c802f17-faff-498a-9ed3-50a9cad6ecdf tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:38.587351 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-0c802f17-faff-498a-9ed3-50a9cad6ecdf tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:38.587905 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-0c802f17-faff-498a-9ed3-50a9cad6ecdf tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:38.732270 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-0c802f17-faff-498a-9ed3-50a9cad6ecdf tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107444106cda461dab7c403665d92613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:22:38.740915 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-0c802f17-faff-498a-9ed3-50a9cad6ecdf tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9" status: 200 len: 1362 microversion: 2.1 time: 0.169806 Dec 14 03:22:38.741526 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 471/967] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:22:38 2021] GET /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9 => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:22:38.868643 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-f188e1d4-2538-4c53-8cd6-0ee01176195d tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:22:38.869471 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-f188e1d4-2538-4c53-8cd6-0ee01176195d tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] [instance: cfd2456c-8f28-4be0-9c97-8e03b0fec041] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:22:38.876367 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f188e1d4-2538-4c53-8cd6-0ee01176195d tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:38.876912 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f188e1d4-2538-4c53-8cd6-0ee01176195d tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:38.877763 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f188e1d4-2538-4c53-8cd6-0ee01176195d tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:38.878269 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f188e1d4-2538-4c53-8cd6-0ee01176195d tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:38.894138 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.wsgi [None req-f188e1d4-2538-4c53-8cd6-0ee01176195d tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] HTTP exception thrown: Instance cfd2456c-8f28-4be0-9c97-8e03b0fec041 could not be found. Dec 14 03:22:38.894741 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-f188e1d4-2538-4c53-8cd6-0ee01176195d tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Returning 404 to user: Instance cfd2456c-8f28-4be0-9c97-8e03b0fec041 could not be found. {{(pid=116072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 03:22:38.895608 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-f188e1d4-2538-4c53-8cd6-0ee01176195d tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "GET /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041" status: 404 len: 111 microversion: 2.1 time: 0.034307 Dec 14 03:22:38.896157 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 497/968] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:22:38 2021] GET /compute/v2.1/servers/cfd2456c-8f28-4be0-9c97-8e03b0fec041 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 14 03:22:38.904379 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-52eb2101-3328-4c62-b27c-0c97113f972d tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] Calling method '.version_select at 0x7fa50811b4c0>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:22:38.926356 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-52eb2101-3328-4c62-b27c-0c97113f972d tempest-TestMinimumBasicScenario-1039232917 tempest-TestMinimumBasicScenario-1039232917-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1501747943" status: 202 len: 0 microversion: 2.1 time: 0.025557 Dec 14 03:22:38.927237 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 472/969] 10.222.0.43 () {58 vars in 1271 bytes} [Tue Dec 14 03:22:38 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1501747943 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:22:38.935675 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-d5d01816-99f1-4d28-8350-eb4b79426301 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:22:38.939916 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-d5d01816-99f1-4d28-8350-eb4b79426301 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:22:38.943788 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d5d01816-99f1-4d28-8350-eb4b79426301 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:38.944318 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d5d01816-99f1-4d28-8350-eb4b79426301 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:38.945148 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d5d01816-99f1-4d28-8350-eb4b79426301 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:38.945573 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d5d01816-99f1-4d28-8350-eb4b79426301 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:39.000332 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [req-16d3fb27-1e90-4d75-a7f5-d21200fa4cac req-2f535c57-ef56-494b-971f-0eefcd49205c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfd2456c-8f28-4be0-9c97-8e03b0fec041", "name": "network-vif-deleted", "tag": "bb3c28d2-c03d-4924-8dd8-da975e5427e4"}]} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:22:39.001941 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:22:39.001941 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: warnings.warn(msg) Dec 14 03:22:39.009207 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [req-16d3fb27-1e90-4d75-a7f5-d21200fa4cac req-2f535c57-ef56-494b-971f-0eefcd49205c service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:39.009659 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [req-16d3fb27-1e90-4d75-a7f5-d21200fa4cac req-2f535c57-ef56-494b-971f-0eefcd49205c service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:39.020860 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.compute.server_external_events [req-16d3fb27-1e90-4d75-a7f5-d21200fa4cac req-2f535c57-ef56-494b-971f-0eefcd49205c service nova] Creating event network-vif-deleted:bb3c28d2-c03d-4924-8dd8-da975e5427e4 for instance cfd2456c-8f28-4be0-9c97-8e03b0fec041 on hv-cinder-81803 Dec 14 03:22:39.025911 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [req-16d3fb27-1e90-4d75-a7f5-d21200fa4cac req-2f535c57-ef56-494b-971f-0eefcd49205c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031062 Dec 14 03:22:39.026632 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 473/970] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Dec 14 03:22:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:22:39.105173 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-d5d01816-99f1-4d28-8350-eb4b79426301 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action" status: 200 len: 27560 microversion: 2.20 time: 0.177428 Dec 14 03:22:39.105814 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 498/971] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:22:38 2021] POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action => generated 27560 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:22:39.759167 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-8805c4ed-cacc-42ec-8368-76473a873cae tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:22:39.759910 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-8805c4ed-cacc-42ec-8368-76473a873cae tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:22:39.766278 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-8805c4ed-cacc-42ec-8368-76473a873cae tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:39.766733 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-8805c4ed-cacc-42ec-8368-76473a873cae tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:39.767560 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-8805c4ed-cacc-42ec-8368-76473a873cae tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:39.768001 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-8805c4ed-cacc-42ec-8368-76473a873cae tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:39.902933 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-8805c4ed-cacc-42ec-8368-76473a873cae tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107444106cda461dab7c403665d92613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:22:39.910402 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-8805c4ed-cacc-42ec-8368-76473a873cae tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9" status: 200 len: 1362 microversion: 2.1 time: 0.156251 Dec 14 03:22:39.911035 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 474/972] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:22:39 2021] GET /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:22:40.119709 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-aec97558-540d-4330-81e4-0149cca0716e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:22:40.120458 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-aec97558-540d-4330-81e4-0149cca0716e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:22:40.128239 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-aec97558-540d-4330-81e4-0149cca0716e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:40.128706 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-aec97558-540d-4330-81e4-0149cca0716e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:40.129495 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-aec97558-540d-4330-81e4-0149cca0716e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:40.129934 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-aec97558-540d-4330-81e4-0149cca0716e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:40.232169 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-aec97558-540d-4330-81e4-0149cca0716e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action" status: 200 len: 27875 microversion: 2.20 time: 0.117931 Dec 14 03:22:40.232820 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 499/973] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:22:40 2021] POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action => generated 27875 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 14 03:22:40.927337 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-f3596d39-46ae-4128-a054-a1d28d8e2a9b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:22:40.927950 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-f3596d39-46ae-4128-a054-a1d28d8e2a9b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:22:40.934427 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-f3596d39-46ae-4128-a054-a1d28d8e2a9b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:40.935330 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-f3596d39-46ae-4128-a054-a1d28d8e2a9b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:40.936323 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-f3596d39-46ae-4128-a054-a1d28d8e2a9b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:40.936924 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-f3596d39-46ae-4128-a054-a1d28d8e2a9b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:41.072152 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-f3596d39-46ae-4128-a054-a1d28d8e2a9b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107444106cda461dab7c403665d92613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:22:41.079322 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-f3596d39-46ae-4128-a054-a1d28d8e2a9b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9" status: 200 len: 1362 microversion: 2.1 time: 0.155830 Dec 14 03:22:41.079888 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 475/974] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:22:40 2021] GET /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:22:41.245570 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-ea7a8585-99d7-46f2-81d2-af3977077946 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:22:41.246764 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-ea7a8585-99d7-46f2-81d2-af3977077946 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:22:41.253852 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ea7a8585-99d7-46f2-81d2-af3977077946 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:41.254533 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ea7a8585-99d7-46f2-81d2-af3977077946 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:41.256042 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ea7a8585-99d7-46f2-81d2-af3977077946 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:41.256668 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ea7a8585-99d7-46f2-81d2-af3977077946 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:41.379953 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-ea7a8585-99d7-46f2-81d2-af3977077946 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action" status: 200 len: 28171 microversion: 2.20 time: 0.138402 Dec 14 03:22:41.381419 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 500/975] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:22:41 2021] POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action => generated 28171 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:22:42.096316 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-77736caf-6760-4773-829e-c6ba57df4d4c tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:22:42.096871 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-77736caf-6760-4773-829e-c6ba57df4d4c tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:22:42.110281 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-77736caf-6760-4773-829e-c6ba57df4d4c tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:42.110731 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-77736caf-6760-4773-829e-c6ba57df4d4c tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:42.111745 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-77736caf-6760-4773-829e-c6ba57df4d4c tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:42.112374 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-77736caf-6760-4773-829e-c6ba57df4d4c tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:42.402347 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-d737acdd-b9d8-4efc-8baf-4f335339447e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:22:42.403423 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-d737acdd-b9d8-4efc-8baf-4f335339447e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:22:42.410865 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d737acdd-b9d8-4efc-8baf-4f335339447e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:42.411472 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d737acdd-b9d8-4efc-8baf-4f335339447e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:42.412959 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d737acdd-b9d8-4efc-8baf-4f335339447e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:42.413584 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d737acdd-b9d8-4efc-8baf-4f335339447e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:42.472539 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-77736caf-6760-4773-829e-c6ba57df4d4c tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107444106cda461dab7c403665d92613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:22:42.483584 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-77736caf-6760-4773-829e-c6ba57df4d4c tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9" status: 200 len: 1362 microversion: 2.1 time: 0.390676 Dec 14 03:22:42.495024 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 476/976] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:22:42 2021] GET /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9 => generated 1362 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:22:42.549683 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-d737acdd-b9d8-4efc-8baf-4f335339447e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action" status: 200 len: 28171 microversion: 2.20 time: 0.160348 Dec 14 03:22:42.554561 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 501/977] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:22:42 2021] POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action => generated 28171 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 14 03:22:43.500691 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-69e28bf7-44f1-41f8-985f-8e645fbd3282 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:22:43.501307 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-69e28bf7-44f1-41f8-985f-8e645fbd3282 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:22:43.507611 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-69e28bf7-44f1-41f8-985f-8e645fbd3282 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:43.508071 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-69e28bf7-44f1-41f8-985f-8e645fbd3282 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:43.508854 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-69e28bf7-44f1-41f8-985f-8e645fbd3282 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:43.509293 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-69e28bf7-44f1-41f8-985f-8e645fbd3282 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:43.564244 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-da4cf670-af88-4b90-8148-2236026d43be tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:22:43.565254 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-da4cf670-af88-4b90-8148-2236026d43be tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:22:43.572051 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-da4cf670-af88-4b90-8148-2236026d43be tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:43.572509 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-da4cf670-af88-4b90-8148-2236026d43be tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:43.573294 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-da4cf670-af88-4b90-8148-2236026d43be tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:43.573731 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-da4cf670-af88-4b90-8148-2236026d43be tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:43.703415 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-da4cf670-af88-4b90-8148-2236026d43be tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action" status: 200 len: 28171 microversion: 2.20 time: 0.143004 Dec 14 03:22:43.704292 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 502/978] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:22:43 2021] POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action => generated 28171 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 14 03:22:43.721274 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-69e28bf7-44f1-41f8-985f-8e645fbd3282 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107444106cda461dab7c403665d92613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:22:43.729412 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-69e28bf7-44f1-41f8-985f-8e645fbd3282 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9" status: 200 len: 1362 microversion: 2.1 time: 0.232259 Dec 14 03:22:43.730086 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 477/979] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:22:43 2021] GET /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9 => generated 1362 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:22:44.713296 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [req-a2c03b93-a9ec-4b9b-932d-52be23e5d25f req-a18c3e55-fda7-4e49-bb20-cb7e5107f11c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f227308f-4d44-4197-9dfd-ddf690c0c0f9", "name": "network-vif-plugged", "status": "completed", "tag": "cf2ca0eb-9e28-4a89-8062-525c1792d08a"}]} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:22:44.718642 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-ba893b08-84d9-4673-b499-292f9f5edf91 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:22:44.719600 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-ba893b08-84d9-4673-b499-292f9f5edf91 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:22:44.721517 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:22:44.721517 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: warnings.warn(msg) Dec 14 03:22:44.731295 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ba893b08-84d9-4673-b499-292f9f5edf91 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:44.731753 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ba893b08-84d9-4673-b499-292f9f5edf91 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:44.732548 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ba893b08-84d9-4673-b499-292f9f5edf91 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:44.732989 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ba893b08-84d9-4673-b499-292f9f5edf91 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:44.743189 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-a2c03b93-a9ec-4b9b-932d-52be23e5d25f req-a18c3e55-fda7-4e49-bb20-cb7e5107f11c service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:44.744075 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-a2c03b93-a9ec-4b9b-932d-52be23e5d25f req-a18c3e55-fda7-4e49-bb20-cb7e5107f11c service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:44.758221 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.compute.server_external_events [req-a2c03b93-a9ec-4b9b-932d-52be23e5d25f req-a18c3e55-fda7-4e49-bb20-cb7e5107f11c service nova] Creating event network-vif-plugged:cf2ca0eb-9e28-4a89-8062-525c1792d08a for instance f227308f-4d44-4197-9dfd-ddf690c0c0f9 on hv-cinder-81803 Dec 14 03:22:44.763799 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [req-a2c03b93-a9ec-4b9b-932d-52be23e5d25f req-a18c3e55-fda7-4e49-bb20-cb7e5107f11c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054503 Dec 14 03:22:44.764956 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 503/980] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Dec 14 03:22:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:22:44.771192 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-3880bd07-c439-420a-9412-ef794183e490 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:22:44.772127 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-3880bd07-c439-420a-9412-ef794183e490 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:22:44.779394 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3880bd07-c439-420a-9412-ef794183e490 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:44.780098 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3880bd07-c439-420a-9412-ef794183e490 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:44.780953 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3880bd07-c439-420a-9412-ef794183e490 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:44.781529 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3880bd07-c439-420a-9412-ef794183e490 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:44.863924 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-ba893b08-84d9-4673-b499-292f9f5edf91 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action" status: 200 len: 28171 microversion: 2.20 time: 0.148673 Dec 14 03:22:44.870782 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 478/981] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:22:44 2021] POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action => generated 28171 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:22:45.038844 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-3880bd07-c439-420a-9412-ef794183e490 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107444106cda461dab7c403665d92613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:22:45.050058 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-3880bd07-c439-420a-9412-ef794183e490 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9" status: 200 len: 1362 microversion: 2.1 time: 0.283190 Dec 14 03:22:45.061212 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 504/982] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:22:44 2021] GET /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9 => generated 1362 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:22:45.882134 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-bb9f8d4b-724d-4310-bb29-79c8bf33a2ec tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:22:45.883732 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-bb9f8d4b-724d-4310-bb29-79c8bf33a2ec tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:22:45.890716 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-bb9f8d4b-724d-4310-bb29-79c8bf33a2ec tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:45.891377 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-bb9f8d4b-724d-4310-bb29-79c8bf33a2ec tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:45.892182 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-bb9f8d4b-724d-4310-bb29-79c8bf33a2ec tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:45.892668 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-bb9f8d4b-724d-4310-bb29-79c8bf33a2ec tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:45.987821 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-bb9f8d4b-724d-4310-bb29-79c8bf33a2ec tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action" status: 200 len: 28171 microversion: 2.20 time: 0.109885 Dec 14 03:22:45.988641 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 479/983] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:22:45 2021] POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action => generated 28171 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:22:46.067568 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-15b8b2b7-9e7f-401b-80d0-e8f7a09140d9 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:22:46.068744 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-15b8b2b7-9e7f-401b-80d0-e8f7a09140d9 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:22:46.077783 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-15b8b2b7-9e7f-401b-80d0-e8f7a09140d9 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:46.078288 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-15b8b2b7-9e7f-401b-80d0-e8f7a09140d9 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:46.079110 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-15b8b2b7-9e7f-401b-80d0-e8f7a09140d9 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:46.079547 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-15b8b2b7-9e7f-401b-80d0-e8f7a09140d9 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:46.228928 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-15b8b2b7-9e7f-401b-80d0-e8f7a09140d9 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107444106cda461dab7c403665d92613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:22:46.236807 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-15b8b2b7-9e7f-401b-80d0-e8f7a09140d9 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9" status: 200 len: 1362 microversion: 2.1 time: 0.172559 Dec 14 03:22:46.238394 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 505/984] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:22:46 2021] GET /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9 => generated 1362 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:22:47.000206 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-33ef6914-2f76-4bcb-bc09-8caa1ef34002 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:22:47.001219 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-33ef6914-2f76-4bcb-bc09-8caa1ef34002 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:22:47.008140 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-33ef6914-2f76-4bcb-bc09-8caa1ef34002 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:47.008598 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-33ef6914-2f76-4bcb-bc09-8caa1ef34002 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:47.009418 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-33ef6914-2f76-4bcb-bc09-8caa1ef34002 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:47.009858 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-33ef6914-2f76-4bcb-bc09-8caa1ef34002 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:47.104712 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-33ef6914-2f76-4bcb-bc09-8caa1ef34002 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action" status: 200 len: 28171 microversion: 2.20 time: 0.108373 Dec 14 03:22:47.105624 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 480/985] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:22:46 2021] POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action => generated 28171 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:22:47.254176 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-a4b92a1e-19af-43e0-ad66-3d77c9abb97d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:22:47.254893 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-a4b92a1e-19af-43e0-ad66-3d77c9abb97d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:22:47.262326 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a4b92a1e-19af-43e0-ad66-3d77c9abb97d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:47.262843 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a4b92a1e-19af-43e0-ad66-3d77c9abb97d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:47.263857 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a4b92a1e-19af-43e0-ad66-3d77c9abb97d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:47.264358 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a4b92a1e-19af-43e0-ad66-3d77c9abb97d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:47.444345 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-a4b92a1e-19af-43e0-ad66-3d77c9abb97d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107444106cda461dab7c403665d92613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:22:47.453017 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-a4b92a1e-19af-43e0-ad66-3d77c9abb97d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9" status: 200 len: 1548 microversion: 2.1 time: 0.202475 Dec 14 03:22:47.453796 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 506/986] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:22:47 2021] GET /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9 => generated 1548 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:22:47.472440 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-752b43a2-a0e4-40df-a8a9-ea5a902df8f5 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:22:47.473036 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-752b43a2-a0e4-40df-a8a9-ea5a902df8f5 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:22:47.480617 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-752b43a2-a0e4-40df-a8a9-ea5a902df8f5 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:47.481272 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-752b43a2-a0e4-40df-a8a9-ea5a902df8f5 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:47.482143 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-752b43a2-a0e4-40df-a8a9-ea5a902df8f5 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:47.482542 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-752b43a2-a0e4-40df-a8a9-ea5a902df8f5 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:47.563447 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-752b43a2-a0e4-40df-a8a9-ea5a902df8f5 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095640 Dec 14 03:22:47.564496 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 481/987] 10.222.0.43 () {58 vars in 1274 bytes} [Tue Dec 14 03:22:47 2021] GET /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:22:48.116420 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-3e3be926-9aaf-4214-9fac-be60e6ff7920 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:22:48.117498 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-3e3be926-9aaf-4214-9fac-be60e6ff7920 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:22:48.123408 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3e3be926-9aaf-4214-9fac-be60e6ff7920 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:48.124101 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3e3be926-9aaf-4214-9fac-be60e6ff7920 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:48.124967 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3e3be926-9aaf-4214-9fac-be60e6ff7920 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:48.125473 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3e3be926-9aaf-4214-9fac-be60e6ff7920 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:48.229337 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-3e3be926-9aaf-4214-9fac-be60e6ff7920 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action" status: 200 len: 28171 microversion: 2.20 time: 0.116187 Dec 14 03:22:48.230426 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 507/988] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:22:48 2021] POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action => generated 28171 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:22:48.978058 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-649a6d08-39bc-4431-8df6-64ced29e0e13 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:22:48.980913 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [req-56c0a8d9-7a70-469e-bd00-ae0a14df3993 req-404d0df7-3b94-4116-9f64-5bc5c25602ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f227308f-4d44-4197-9dfd-ddf690c0c0f9", "tag": "cf2ca0eb-9e28-4a89-8062-525c1792d08a"}]} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:22:48.982415 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-649a6d08-39bc-4431-8df6-64ced29e0e13 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:22:48.984445 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:22:48.984445 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: warnings.warn(msg) Dec 14 03:22:48.999376 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-649a6d08-39bc-4431-8df6-64ced29e0e13 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:49.004368 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-56c0a8d9-7a70-469e-bd00-ae0a14df3993 req-404d0df7-3b94-4116-9f64-5bc5c25602ee service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:49.005610 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-649a6d08-39bc-4431-8df6-64ced29e0e13 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:49.006453 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-649a6d08-39bc-4431-8df6-64ced29e0e13 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:49.006936 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-649a6d08-39bc-4431-8df6-64ced29e0e13 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:49.009885 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-56c0a8d9-7a70-469e-bd00-ae0a14df3993 req-404d0df7-3b94-4116-9f64-5bc5c25602ee service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:49.021952 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.compute.server_external_events [req-56c0a8d9-7a70-469e-bd00-ae0a14df3993 req-404d0df7-3b94-4116-9f64-5bc5c25602ee service nova] Creating event network-changed:cf2ca0eb-9e28-4a89-8062-525c1792d08a for instance f227308f-4d44-4197-9dfd-ddf690c0c0f9 on hv-cinder-81803 Dec 14 03:22:49.026900 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [req-56c0a8d9-7a70-469e-bd00-ae0a14df3993 req-404d0df7-3b94-4116-9f64-5bc5c25602ee service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053432 Dec 14 03:22:49.028024 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 508/989] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Dec 14 03:22:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 14 03:22:49.109193 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-649a6d08-39bc-4431-8df6-64ced29e0e13 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action" status: 200 len: 14 microversion: 2.1 time: 0.139709 Dec 14 03:22:49.111164 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 482/990] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:22:48 2021] POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action => generated 14 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 14 03:22:49.243142 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-c2051d01-5d2e-45ff-a80a-de14451d5bd6 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:22:49.244583 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-c2051d01-5d2e-45ff-a80a-de14451d5bd6 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:22:49.255306 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c2051d01-5d2e-45ff-a80a-de14451d5bd6 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:49.256064 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c2051d01-5d2e-45ff-a80a-de14451d5bd6 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:49.257085 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c2051d01-5d2e-45ff-a80a-de14451d5bd6 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:49.257687 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c2051d01-5d2e-45ff-a80a-de14451d5bd6 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:49.350216 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-c2051d01-5d2e-45ff-a80a-de14451d5bd6 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action" status: 200 len: 28171 microversion: 2.20 time: 0.110991 Dec 14 03:22:49.351016 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 509/991] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:22:49 2021] POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action => generated 28171 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:22:50.122803 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-cf786fa2-ce36-42d0-b31e-d1ba381f3954 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:22:50.123907 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-cf786fa2-ce36-42d0-b31e-d1ba381f3954 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:22:50.131724 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-cf786fa2-ce36-42d0-b31e-d1ba381f3954 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:50.132187 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-cf786fa2-ce36-42d0-b31e-d1ba381f3954 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:50.133014 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-cf786fa2-ce36-42d0-b31e-d1ba381f3954 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:50.133460 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-cf786fa2-ce36-42d0-b31e-d1ba381f3954 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:50.218412 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-cf786fa2-ce36-42d0-b31e-d1ba381f3954 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action" status: 200 len: 14 microversion: 2.1 time: 0.100206 Dec 14 03:22:50.222656 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 483/992] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:22:50 2021] POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action => generated 14 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 14 03:22:50.363861 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-94fcc805-aa23-4699-8953-96fff293536a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:22:50.366289 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-94fcc805-aa23-4699-8953-96fff293536a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:22:50.381663 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-94fcc805-aa23-4699-8953-96fff293536a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:50.382107 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-94fcc805-aa23-4699-8953-96fff293536a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:50.382914 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-94fcc805-aa23-4699-8953-96fff293536a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:50.383410 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-94fcc805-aa23-4699-8953-96fff293536a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:50.486713 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-94fcc805-aa23-4699-8953-96fff293536a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action" status: 200 len: 28171 microversion: 2.20 time: 0.128127 Dec 14 03:22:50.487745 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 510/993] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:22:50 2021] POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action => generated 28171 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:22:51.232076 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-706bd58b-8ac5-4d4c-aeec-4fa0be74ebfe tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:22:51.235027 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-706bd58b-8ac5-4d4c-aeec-4fa0be74ebfe tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:22:51.242773 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-706bd58b-8ac5-4d4c-aeec-4fa0be74ebfe tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:51.244252 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-706bd58b-8ac5-4d4c-aeec-4fa0be74ebfe tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:51.248985 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-706bd58b-8ac5-4d4c-aeec-4fa0be74ebfe tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:51.249502 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-706bd58b-8ac5-4d4c-aeec-4fa0be74ebfe tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:51.344327 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-706bd58b-8ac5-4d4c-aeec-4fa0be74ebfe tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action" status: 200 len: 14 microversion: 2.1 time: 0.117576 Dec 14 03:22:51.346053 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 484/994] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:22:51 2021] POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action => generated 14 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 14 03:22:51.501623 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-93b93a47-f64b-45e9-a0ba-b88843f87da6 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:22:51.503323 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-93b93a47-f64b-45e9-a0ba-b88843f87da6 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:22:51.510929 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-93b93a47-f64b-45e9-a0ba-b88843f87da6 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:51.511405 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-93b93a47-f64b-45e9-a0ba-b88843f87da6 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:51.512506 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-93b93a47-f64b-45e9-a0ba-b88843f87da6 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:51.513103 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-93b93a47-f64b-45e9-a0ba-b88843f87da6 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:51.599783 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-93b93a47-f64b-45e9-a0ba-b88843f87da6 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action" status: 200 len: 28171 microversion: 2.20 time: 0.102112 Dec 14 03:22:51.605267 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 511/995] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:22:51 2021] POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action => generated 28171 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:22:52.357165 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-3c0a7fc4-2cbc-4be8-aed8-d2869343ee22 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:22:52.360686 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-3c0a7fc4-2cbc-4be8-aed8-d2869343ee22 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:22:52.372127 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-3c0a7fc4-2cbc-4be8-aed8-d2869343ee22 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:52.372597 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-3c0a7fc4-2cbc-4be8-aed8-d2869343ee22 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:52.373411 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-3c0a7fc4-2cbc-4be8-aed8-d2869343ee22 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:52.373860 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-3c0a7fc4-2cbc-4be8-aed8-d2869343ee22 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:52.464093 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-3c0a7fc4-2cbc-4be8-aed8-d2869343ee22 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action" status: 200 len: 14 microversion: 2.1 time: 0.111169 Dec 14 03:22:52.465821 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 485/996] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:22:52 2021] POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action => generated 14 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 14 03:22:52.613506 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-378c0229-113c-4d8d-a644-0b95663df0ff tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:22:52.614940 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-378c0229-113c-4d8d-a644-0b95663df0ff tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:22:52.624782 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-378c0229-113c-4d8d-a644-0b95663df0ff tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:52.625163 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-378c0229-113c-4d8d-a644-0b95663df0ff tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:52.625975 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-378c0229-113c-4d8d-a644-0b95663df0ff tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:52.626413 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-378c0229-113c-4d8d-a644-0b95663df0ff tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:52.721029 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-378c0229-113c-4d8d-a644-0b95663df0ff tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action" status: 200 len: 28171 microversion: 2.20 time: 0.111855 Dec 14 03:22:52.722570 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 512/997] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:22:52 2021] POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action => generated 28171 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:22:53.478244 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-49a0de3e-cb3c-4357-a368-4d816ae972ce tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:22:53.479703 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-49a0de3e-cb3c-4357-a368-4d816ae972ce tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:22:53.486940 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-49a0de3e-cb3c-4357-a368-4d816ae972ce tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:53.487916 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-49a0de3e-cb3c-4357-a368-4d816ae972ce tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:53.488976 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-49a0de3e-cb3c-4357-a368-4d816ae972ce tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:53.490103 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-49a0de3e-cb3c-4357-a368-4d816ae972ce tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:53.577631 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-49a0de3e-cb3c-4357-a368-4d816ae972ce tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action" status: 200 len: 14 microversion: 2.1 time: 0.105089 Dec 14 03:22:53.578242 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 486/998] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:22:53 2021] POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action => generated 14 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 14 03:22:53.736938 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-6d107dd2-7082-44e4-aeb4-57059812d590 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:22:53.738469 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-6d107dd2-7082-44e4-aeb4-57059812d590 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:22:53.752646 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6d107dd2-7082-44e4-aeb4-57059812d590 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:53.754384 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6d107dd2-7082-44e4-aeb4-57059812d590 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:53.755751 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6d107dd2-7082-44e4-aeb4-57059812d590 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:53.756422 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6d107dd2-7082-44e4-aeb4-57059812d590 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:53.858058 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-6d107dd2-7082-44e4-aeb4-57059812d590 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action" status: 200 len: 28462 microversion: 2.20 time: 0.128465 Dec 14 03:22:53.859213 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 513/999] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:22:53 2021] POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action => generated 28462 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:22:54.589450 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-5b182b2f-24a7-4c92-8da9-06363166abef tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:22:54.591262 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-5b182b2f-24a7-4c92-8da9-06363166abef tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:22:54.603784 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-5b182b2f-24a7-4c92-8da9-06363166abef tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:54.604676 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-5b182b2f-24a7-4c92-8da9-06363166abef tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:54.605972 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-5b182b2f-24a7-4c92-8da9-06363166abef tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:54.608317 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-5b182b2f-24a7-4c92-8da9-06363166abef tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:54.704030 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-5b182b2f-24a7-4c92-8da9-06363166abef tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action" status: 200 len: 14 microversion: 2.1 time: 0.118555 Dec 14 03:22:54.705276 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 487/1000] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:22:54 2021] POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action => generated 14 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 14 03:22:54.870888 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-0dc98b9c-de47-46b9-a846-d394c080d431 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:22:54.872070 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-0dc98b9c-de47-46b9-a846-d394c080d431 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:22:54.881766 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0dc98b9c-de47-46b9-a846-d394c080d431 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:54.882548 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0dc98b9c-de47-46b9-a846-d394c080d431 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:54.883452 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0dc98b9c-de47-46b9-a846-d394c080d431 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:54.883979 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0dc98b9c-de47-46b9-a846-d394c080d431 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:54.970025 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-0dc98b9c-de47-46b9-a846-d394c080d431 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action" status: 200 len: 28462 microversion: 2.20 time: 0.102531 Dec 14 03:22:54.972062 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 514/1001] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:22:54 2021] POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action => generated 28462 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:22:55.716328 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-860ca008-11ef-4f25-b604-0ee92249592e tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:22:55.717212 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-860ca008-11ef-4f25-b604-0ee92249592e tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:22:55.729647 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-860ca008-11ef-4f25-b604-0ee92249592e tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:55.730468 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-860ca008-11ef-4f25-b604-0ee92249592e tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:55.735462 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-860ca008-11ef-4f25-b604-0ee92249592e tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:55.736211 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-860ca008-11ef-4f25-b604-0ee92249592e tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:55.842981 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-860ca008-11ef-4f25-b604-0ee92249592e tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action" status: 200 len: 14 microversion: 2.1 time: 0.130902 Dec 14 03:22:55.844100 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 488/1002] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:22:55 2021] POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action => generated 14 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 14 03:22:55.982937 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-670db9a9-57b8-4e49-a729-7519c67aae00 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:22:55.989272 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-670db9a9-57b8-4e49-a729-7519c67aae00 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:22:56.000077 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-670db9a9-57b8-4e49-a729-7519c67aae00 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:56.000857 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-670db9a9-57b8-4e49-a729-7519c67aae00 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:56.001838 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-670db9a9-57b8-4e49-a729-7519c67aae00 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:56.002428 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-670db9a9-57b8-4e49-a729-7519c67aae00 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:56.139396 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-670db9a9-57b8-4e49-a729-7519c67aae00 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action" status: 200 len: 28630 microversion: 2.20 time: 0.160870 Dec 14 03:22:56.141033 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 515/1003] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:22:55 2021] POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action => generated 28630 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:22:56.855265 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-9198ee3d-2383-4554-ab3d-28ae46cfb1b7 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:22:56.857025 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-9198ee3d-2383-4554-ab3d-28ae46cfb1b7 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:22:56.864396 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-9198ee3d-2383-4554-ab3d-28ae46cfb1b7 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:56.864986 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-9198ee3d-2383-4554-ab3d-28ae46cfb1b7 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:56.866044 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-9198ee3d-2383-4554-ab3d-28ae46cfb1b7 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:56.866712 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-9198ee3d-2383-4554-ab3d-28ae46cfb1b7 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:56.961625 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-9198ee3d-2383-4554-ab3d-28ae46cfb1b7 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action" status: 200 len: 14 microversion: 2.1 time: 0.110246 Dec 14 03:22:56.962893 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 489/1004] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:22:56 2021] POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action => generated 14 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 14 03:22:57.154396 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-3b164fca-29ae-4245-a0b1-cb03dbb62b1c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:22:57.158079 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-3b164fca-29ae-4245-a0b1-cb03dbb62b1c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:22:57.165416 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3b164fca-29ae-4245-a0b1-cb03dbb62b1c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:57.165968 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3b164fca-29ae-4245-a0b1-cb03dbb62b1c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:57.167267 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3b164fca-29ae-4245-a0b1-cb03dbb62b1c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:57.167940 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3b164fca-29ae-4245-a0b1-cb03dbb62b1c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:57.260756 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-3b164fca-29ae-4245-a0b1-cb03dbb62b1c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action" status: 200 len: 28630 microversion: 2.20 time: 0.111548 Dec 14 03:22:57.266553 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 516/1005] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:22:57 2021] POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action => generated 28630 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:22:57.647132 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-6f33086d-7971-458b-b23f-6962937f01bc tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Action: 'create', calling method: .version_select at 0x7fa5037fa310>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-801497898"}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:22:57.662077 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.quota [None req-6f33086d-7971-458b-b23f-6962937f01bc tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Getting quotas for project d0c4dcf4957d42b896f04f682afeef7b. Resources: {'key_pairs'} {{(pid=116071) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 03:22:57.665988 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.quota [None req-6f33086d-7971-458b-b23f-6962937f01bc tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Getting quotas for user bf869873369f496e9e25a6d6b2a7ba86 and project d0c4dcf4957d42b896f04f682afeef7b. Resources: {'key_pairs'} {{(pid=116071) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 03:22:57.868784 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.quota [None req-6f33086d-7971-458b-b23f-6962937f01bc tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Getting quotas for project d0c4dcf4957d42b896f04f682afeef7b. Resources: {'key_pairs'} {{(pid=116071) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 03:22:57.872718 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.quota [None req-6f33086d-7971-458b-b23f-6962937f01bc tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Getting quotas for user bf869873369f496e9e25a6d6b2a7ba86 and project d0c4dcf4957d42b896f04f682afeef7b. Resources: {'key_pairs'} {{(pid=116071) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 03:22:57.886056 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-6f33086d-7971-458b-b23f-6962937f01bc tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 2314 microversion: 2.1 time: 0.411638 Dec 14 03:22:57.886839 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 490/1006] 10.222.0.43 () {60 vars in 1157 bytes} [Tue Dec 14 03:22:57 2021] POST /compute/v2.1/os-keypairs => generated 2314 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:22:57.975662 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-60458217-d1f3-486a-a000-1dad022209b7 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:22:57.976872 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-60458217-d1f3-486a-a000-1dad022209b7 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:22:57.984173 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-60458217-d1f3-486a-a000-1dad022209b7 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:57.985598 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-60458217-d1f3-486a-a000-1dad022209b7 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:57.985744 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-60458217-d1f3-486a-a000-1dad022209b7 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:57.986100 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-60458217-d1f3-486a-a000-1dad022209b7 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:58.072672 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-60458217-d1f3-486a-a000-1dad022209b7 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action" status: 200 len: 14 microversion: 2.1 time: 0.102683 Dec 14 03:22:58.073696 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 517/1007] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:22:57 2021] POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action => generated 14 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 14 03:22:58.274838 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-21bd317d-c20a-484f-8792-44da177bf03f tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:22:58.275967 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-21bd317d-c20a-484f-8792-44da177bf03f tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:22:58.282015 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-21bd317d-c20a-484f-8792-44da177bf03f tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:58.282468 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-21bd317d-c20a-484f-8792-44da177bf03f tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:58.283383 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-21bd317d-c20a-484f-8792-44da177bf03f tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:58.283828 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-21bd317d-c20a-484f-8792-44da177bf03f tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:58.371597 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-21bd317d-c20a-484f-8792-44da177bf03f tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action" status: 200 len: 28630 microversion: 2.20 time: 0.101216 Dec 14 03:22:58.375570 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 491/1008] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:22:58 2021] POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action => generated 28630 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:22:59.084692 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-517ad244-abca-49d2-b2eb-008e41ac6416 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:22:59.085740 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-517ad244-abca-49d2-b2eb-008e41ac6416 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:22:59.092681 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-517ad244-abca-49d2-b2eb-008e41ac6416 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:59.093126 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-517ad244-abca-49d2-b2eb-008e41ac6416 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:59.093906 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-517ad244-abca-49d2-b2eb-008e41ac6416 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:59.094332 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-517ad244-abca-49d2-b2eb-008e41ac6416 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:59.182067 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-517ad244-abca-49d2-b2eb-008e41ac6416 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action" status: 200 len: 8321 microversion: 2.1 time: 0.101716 Dec 14 03:22:59.182808 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 518/1009] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:22:59 2021] POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action => generated 8321 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:22:59.384283 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-8892060d-60d2-42bc-9aa3-b538d402c14a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:22:59.385352 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-8892060d-60d2-42bc-9aa3-b538d402c14a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:22:59.392802 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-8892060d-60d2-42bc-9aa3-b538d402c14a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:59.393215 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-8892060d-60d2-42bc-9aa3-b538d402c14a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:59.394044 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-8892060d-60d2-42bc-9aa3-b538d402c14a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:22:59.394549 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-8892060d-60d2-42bc-9aa3-b538d402c14a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:22:59.478705 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-8892060d-60d2-42bc-9aa3-b538d402c14a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action" status: 200 len: 28630 microversion: 2.20 time: 0.098773 Dec 14 03:22:59.480309 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 492/1010] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:22:59 2021] POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action => generated 28630 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:23:00.194005 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-5144fe1f-2b23-4a1e-8cb2-d48539d05280 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:23:00.195025 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-5144fe1f-2b23-4a1e-8cb2-d48539d05280 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:00.202168 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5144fe1f-2b23-4a1e-8cb2-d48539d05280 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:00.202619 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5144fe1f-2b23-4a1e-8cb2-d48539d05280 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:00.203450 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5144fe1f-2b23-4a1e-8cb2-d48539d05280 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:00.203894 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5144fe1f-2b23-4a1e-8cb2-d48539d05280 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:00.303055 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-5144fe1f-2b23-4a1e-8cb2-d48539d05280 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action" status: 200 len: 15374 microversion: 2.1 time: 0.112982 Dec 14 03:23:00.303712 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 519/1011] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:23:00 2021] POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action => generated 15374 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:23:00.491083 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-a5e48faa-ebd7-49ed-9236-2dd9cd21ae77 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:23:00.492241 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-a5e48faa-ebd7-49ed-9236-2dd9cd21ae77 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:00.499280 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a5e48faa-ebd7-49ed-9236-2dd9cd21ae77 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:00.499740 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a5e48faa-ebd7-49ed-9236-2dd9cd21ae77 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:00.500543 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a5e48faa-ebd7-49ed-9236-2dd9cd21ae77 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:00.500991 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a5e48faa-ebd7-49ed-9236-2dd9cd21ae77 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:00.603417 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-a5e48faa-ebd7-49ed-9236-2dd9cd21ae77 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action" status: 200 len: 28630 microversion: 2.20 time: 0.116940 Dec 14 03:23:00.604764 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 493/1012] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:23:00 2021] POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action => generated 28630 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:23:01.314373 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-0e1d89b9-f788-458d-9820-53ed430ddf9e tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:23:01.315399 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-0e1d89b9-f788-458d-9820-53ed430ddf9e tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:01.322333 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0e1d89b9-f788-458d-9820-53ed430ddf9e tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:01.322907 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0e1d89b9-f788-458d-9820-53ed430ddf9e tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:01.323717 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0e1d89b9-f788-458d-9820-53ed430ddf9e tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:01.324150 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0e1d89b9-f788-458d-9820-53ed430ddf9e tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:01.419969 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-0e1d89b9-f788-458d-9820-53ed430ddf9e tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action" status: 200 len: 18155 microversion: 2.1 time: 0.109419 Dec 14 03:23:01.421019 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 520/1013] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:23:01 2021] POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action => generated 18155 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:23:01.616631 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-6348fdb7-fb62-4092-84a3-fa9137f4f787 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:23:01.617762 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-6348fdb7-fb62-4092-84a3-fa9137f4f787 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:01.638543 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-6348fdb7-fb62-4092-84a3-fa9137f4f787 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:01.640490 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-6348fdb7-fb62-4092-84a3-fa9137f4f787 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:01.641165 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-6348fdb7-fb62-4092-84a3-fa9137f4f787 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:01.641706 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-6348fdb7-fb62-4092-84a3-fa9137f4f787 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:01.733675 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-6348fdb7-fb62-4092-84a3-fa9137f4f787 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action" status: 200 len: 28630 microversion: 2.20 time: 0.120980 Dec 14 03:23:01.734405 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 494/1014] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:23:01 2021] POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action => generated 28630 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:23:02.432815 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-6534261e-5794-47d1-81d1-b3af52b0f19d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:23:02.433820 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-6534261e-5794-47d1-81d1-b3af52b0f19d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:02.440790 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6534261e-5794-47d1-81d1-b3af52b0f19d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:02.441238 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6534261e-5794-47d1-81d1-b3af52b0f19d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:02.442019 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6534261e-5794-47d1-81d1-b3af52b0f19d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:02.442491 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6534261e-5794-47d1-81d1-b3af52b0f19d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:02.535612 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-6534261e-5794-47d1-81d1-b3af52b0f19d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action" status: 200 len: 19342 microversion: 2.1 time: 0.106594 Dec 14 03:23:02.536781 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 521/1015] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:23:02 2021] POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action => generated 19342 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:23:02.748193 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-79ec93f3-4ee1-4c9c-ba08-fdbfd63fc5e0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:23:02.749205 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-79ec93f3-4ee1-4c9c-ba08-fdbfd63fc5e0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:02.756400 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-79ec93f3-4ee1-4c9c-ba08-fdbfd63fc5e0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:02.756908 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-79ec93f3-4ee1-4c9c-ba08-fdbfd63fc5e0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:02.757680 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-79ec93f3-4ee1-4c9c-ba08-fdbfd63fc5e0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:02.758120 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-79ec93f3-4ee1-4c9c-ba08-fdbfd63fc5e0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:02.864906 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-79ec93f3-4ee1-4c9c-ba08-fdbfd63fc5e0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action" status: 200 len: 28630 microversion: 2.20 time: 0.120625 Dec 14 03:23:02.865971 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 495/1016] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:23:02 2021] POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action => generated 28630 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:23:03.548093 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-754ebfd5-978c-4094-9f44-a5ed721035f3 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:23:03.549086 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-754ebfd5-978c-4094-9f44-a5ed721035f3 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:03.555894 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-754ebfd5-978c-4094-9f44-a5ed721035f3 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:03.556339 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-754ebfd5-978c-4094-9f44-a5ed721035f3 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:03.557107 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-754ebfd5-978c-4094-9f44-a5ed721035f3 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:03.557541 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-754ebfd5-978c-4094-9f44-a5ed721035f3 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:03.664344 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-754ebfd5-978c-4094-9f44-a5ed721035f3 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action" status: 200 len: 21972 microversion: 2.1 time: 0.120055 Dec 14 03:23:03.665029 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 522/1017] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:23:03 2021] POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action => generated 21972 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:23:03.877295 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-d1978948-fc60-4336-b67a-66da96060576 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:23:03.878310 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-d1978948-fc60-4336-b67a-66da96060576 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:03.885639 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-d1978948-fc60-4336-b67a-66da96060576 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:03.886094 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-d1978948-fc60-4336-b67a-66da96060576 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:03.886876 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-d1978948-fc60-4336-b67a-66da96060576 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:03.887355 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-d1978948-fc60-4336-b67a-66da96060576 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:03.984182 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-d1978948-fc60-4336-b67a-66da96060576 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action" status: 200 len: 28630 microversion: 2.20 time: 0.110672 Dec 14 03:23:03.984742 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 496/1018] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:23:03 2021] POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action => generated 28630 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:23:04.676386 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-aff15470-dcc4-468d-a94b-b751d473e2a0 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:23:04.677399 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-aff15470-dcc4-468d-a94b-b751d473e2a0 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:04.684247 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-aff15470-dcc4-468d-a94b-b751d473e2a0 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:04.684698 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-aff15470-dcc4-468d-a94b-b751d473e2a0 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:04.685483 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-aff15470-dcc4-468d-a94b-b751d473e2a0 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:04.685923 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-aff15470-dcc4-468d-a94b-b751d473e2a0 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:04.778439 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-aff15470-dcc4-468d-a94b-b751d473e2a0 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action" status: 200 len: 23234 microversion: 2.1 time: 0.106064 Dec 14 03:23:04.779125 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 523/1019] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:23:04 2021] POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action => generated 23234 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:23:04.996342 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-dade590e-3b30-4b8e-abf6-41db37eb3f59 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:23:04.997342 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-dade590e-3b30-4b8e-abf6-41db37eb3f59 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:05.004081 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-dade590e-3b30-4b8e-abf6-41db37eb3f59 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:05.004530 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-dade590e-3b30-4b8e-abf6-41db37eb3f59 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:05.005303 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-dade590e-3b30-4b8e-abf6-41db37eb3f59 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:05.005738 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-dade590e-3b30-4b8e-abf6-41db37eb3f59 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:05.094898 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-dade590e-3b30-4b8e-abf6-41db37eb3f59 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action" status: 200 len: 28630 microversion: 2.20 time: 0.102376 Dec 14 03:23:05.095693 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 497/1020] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:23:04 2021] POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action => generated 28630 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:23:05.796283 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-214bdc57-30da-4606-9155-c4987064f991 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:23:05.797294 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-214bdc57-30da-4606-9155-c4987064f991 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:05.804252 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-214bdc57-30da-4606-9155-c4987064f991 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:05.804706 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-214bdc57-30da-4606-9155-c4987064f991 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:05.805495 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-214bdc57-30da-4606-9155-c4987064f991 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:05.805935 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-214bdc57-30da-4606-9155-c4987064f991 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:05.901281 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-214bdc57-30da-4606-9155-c4987064f991 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action" status: 200 len: 24712 microversion: 2.1 time: 0.109076 Dec 14 03:23:05.901939 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 524/1021] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:23:05 2021] POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action => generated 24712 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:23:06.107944 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-436947ab-5a39-45e3-b1a6-d539db6280be tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:23:06.108958 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-436947ab-5a39-45e3-b1a6-d539db6280be tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:06.117468 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-436947ab-5a39-45e3-b1a6-d539db6280be tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:06.117935 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-436947ab-5a39-45e3-b1a6-d539db6280be tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:06.118765 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-436947ab-5a39-45e3-b1a6-d539db6280be tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:06.119236 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-436947ab-5a39-45e3-b1a6-d539db6280be tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:06.205869 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-436947ab-5a39-45e3-b1a6-d539db6280be tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action" status: 200 len: 28630 microversion: 2.20 time: 0.101891 Dec 14 03:23:06.206695 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 498/1022] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:23:06 2021] POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action => generated 28630 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:23:06.913351 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-985366a1-fd0d-4ada-9129-c91c9faeb534 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:23:06.914370 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-985366a1-fd0d-4ada-9129-c91c9faeb534 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:06.921234 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-985366a1-fd0d-4ada-9129-c91c9faeb534 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:06.921681 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-985366a1-fd0d-4ada-9129-c91c9faeb534 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:06.922460 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-985366a1-fd0d-4ada-9129-c91c9faeb534 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:06.922917 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-985366a1-fd0d-4ada-9129-c91c9faeb534 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:07.039168 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-985366a1-fd0d-4ada-9129-c91c9faeb534 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action" status: 200 len: 26076 microversion: 2.1 time: 0.129631 Dec 14 03:23:07.039829 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 525/1023] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:23:06 2021] POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action => generated 26076 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:23:07.218070 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-dc7a8e88-06e0-4264-b3f1-879c5a897bfc tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:23:07.218993 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-dc7a8e88-06e0-4264-b3f1-879c5a897bfc tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:07.226449 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-dc7a8e88-06e0-4264-b3f1-879c5a897bfc tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:07.226905 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-dc7a8e88-06e0-4264-b3f1-879c5a897bfc tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:07.227744 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-dc7a8e88-06e0-4264-b3f1-879c5a897bfc tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:07.228183 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-dc7a8e88-06e0-4264-b3f1-879c5a897bfc tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:07.315191 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-dc7a8e88-06e0-4264-b3f1-879c5a897bfc tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action" status: 200 len: 28630 microversion: 2.20 time: 0.101035 Dec 14 03:23:07.316138 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 499/1024] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:23:07 2021] POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action => generated 28630 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:23:08.051416 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-8424c1b2-3d77-4ba2-a5c4-caf2740965a0 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:23:08.052854 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-8424c1b2-3d77-4ba2-a5c4-caf2740965a0 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:08.059679 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8424c1b2-3d77-4ba2-a5c4-caf2740965a0 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:08.060130 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8424c1b2-3d77-4ba2-a5c4-caf2740965a0 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:08.060909 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8424c1b2-3d77-4ba2-a5c4-caf2740965a0 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:08.061349 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8424c1b2-3d77-4ba2-a5c4-caf2740965a0 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:08.158405 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-8424c1b2-3d77-4ba2-a5c4-caf2740965a0 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action" status: 200 len: 27112 microversion: 2.1 time: 0.110898 Dec 14 03:23:08.159070 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 526/1025] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:23:08 2021] POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action => generated 27112 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:23:08.327556 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-c2e6df52-9f1f-475a-aaaf-1bf9fdb25bbb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:23:08.328567 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-c2e6df52-9f1f-475a-aaaf-1bf9fdb25bbb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:08.335463 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c2e6df52-9f1f-475a-aaaf-1bf9fdb25bbb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:08.335920 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c2e6df52-9f1f-475a-aaaf-1bf9fdb25bbb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:08.336835 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c2e6df52-9f1f-475a-aaaf-1bf9fdb25bbb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:08.337149 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c2e6df52-9f1f-475a-aaaf-1bf9fdb25bbb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:08.428303 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-c2e6df52-9f1f-475a-aaaf-1bf9fdb25bbb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action" status: 200 len: 28630 microversion: 2.20 time: 0.104665 Dec 14 03:23:08.428945 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 500/1026] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:23:08 2021] POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action => generated 28630 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:23:09.170928 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-f8c8f838-2872-4c49-8763-5b58114247ae tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:23:09.172105 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-f8c8f838-2872-4c49-8763-5b58114247ae tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:09.179135 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f8c8f838-2872-4c49-8763-5b58114247ae tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:09.179591 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f8c8f838-2872-4c49-8763-5b58114247ae tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:09.180388 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f8c8f838-2872-4c49-8763-5b58114247ae tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:09.180825 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f8c8f838-2872-4c49-8763-5b58114247ae tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:09.284880 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-f8c8f838-2872-4c49-8763-5b58114247ae tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action" status: 200 len: 27670 microversion: 2.1 time: 0.117842 Dec 14 03:23:09.285450 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 527/1027] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:23:09 2021] POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action => generated 27670 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:23:09.441260 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-bd5d64a1-0c4a-4f7d-9ee1-a77ef1148bb9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:23:09.443057 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-bd5d64a1-0c4a-4f7d-9ee1-a77ef1148bb9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:09.450362 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-bd5d64a1-0c4a-4f7d-9ee1-a77ef1148bb9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:09.450838 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-bd5d64a1-0c4a-4f7d-9ee1-a77ef1148bb9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:09.451709 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-bd5d64a1-0c4a-4f7d-9ee1-a77ef1148bb9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:09.452147 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-bd5d64a1-0c4a-4f7d-9ee1-a77ef1148bb9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:09.543560 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-bd5d64a1-0c4a-4f7d-9ee1-a77ef1148bb9 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action" status: 200 len: 28630 microversion: 2.20 time: 0.106312 Dec 14 03:23:09.544366 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 501/1028] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:23:09 2021] POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action => generated 28630 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 14 03:23:10.297227 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-7d5a98c6-70c7-49c5-9a6b-b9fd08ba69f5 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:23:10.298129 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-7d5a98c6-70c7-49c5-9a6b-b9fd08ba69f5 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:10.305013 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7d5a98c6-70c7-49c5-9a6b-b9fd08ba69f5 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:10.305455 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7d5a98c6-70c7-49c5-9a6b-b9fd08ba69f5 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:10.306222 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7d5a98c6-70c7-49c5-9a6b-b9fd08ba69f5 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:10.306653 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7d5a98c6-70c7-49c5-9a6b-b9fd08ba69f5 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:10.409878 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-7d5a98c6-70c7-49c5-9a6b-b9fd08ba69f5 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action" status: 200 len: 27837 microversion: 2.1 time: 0.116533 Dec 14 03:23:10.410518 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 528/1029] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:23:10 2021] POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action => generated 27837 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:23:10.556023 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-f709dfdd-34d3-40db-9653-97a157b3ef4e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:23:10.556991 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-f709dfdd-34d3-40db-9653-97a157b3ef4e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:10.564357 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-f709dfdd-34d3-40db-9653-97a157b3ef4e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:10.564819 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-f709dfdd-34d3-40db-9653-97a157b3ef4e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:10.565619 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-f709dfdd-34d3-40db-9653-97a157b3ef4e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:10.566061 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-f709dfdd-34d3-40db-9653-97a157b3ef4e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:10.652169 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-f709dfdd-34d3-40db-9653-97a157b3ef4e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action" status: 200 len: 28630 microversion: 2.20 time: 0.100964 Dec 14 03:23:10.652790 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 502/1030] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:23:10 2021] POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action => generated 28630 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:23:11.422048 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-3aadbc36-b665-49d2-b10d-d4ec688df0e8 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:23:11.423062 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-3aadbc36-b665-49d2-b10d-d4ec688df0e8 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:11.430009 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3aadbc36-b665-49d2-b10d-d4ec688df0e8 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:11.430456 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3aadbc36-b665-49d2-b10d-d4ec688df0e8 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:11.431327 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3aadbc36-b665-49d2-b10d-d4ec688df0e8 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:11.431764 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3aadbc36-b665-49d2-b10d-d4ec688df0e8 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:11.523680 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-3aadbc36-b665-49d2-b10d-d4ec688df0e8 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action" status: 200 len: 28216 microversion: 2.1 time: 0.105465 Dec 14 03:23:11.524225 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 529/1031] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:23:11 2021] POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action => generated 28216 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:23:11.664291 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-ac446488-e971-46c9-8b6c-2d39007875b1 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:23:11.665303 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-ac446488-e971-46c9-8b6c-2d39007875b1 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:11.672358 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ac446488-e971-46c9-8b6c-2d39007875b1 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:11.672823 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ac446488-e971-46c9-8b6c-2d39007875b1 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:11.673613 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ac446488-e971-46c9-8b6c-2d39007875b1 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:11.674053 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ac446488-e971-46c9-8b6c-2d39007875b1 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:11.759823 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-ac446488-e971-46c9-8b6c-2d39007875b1 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action" status: 200 len: 28630 microversion: 2.20 time: 0.099426 Dec 14 03:23:11.763702 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 503/1032] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:23:11 2021] POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action => generated 28630 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:23:12.535002 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-df4aa6bb-0385-4049-ad5e-eef30aa1dde5 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:23:12.536656 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-df4aa6bb-0385-4049-ad5e-eef30aa1dde5 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:12.543440 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-df4aa6bb-0385-4049-ad5e-eef30aa1dde5 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:12.543883 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-df4aa6bb-0385-4049-ad5e-eef30aa1dde5 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:12.544649 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-df4aa6bb-0385-4049-ad5e-eef30aa1dde5 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:12.545079 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-df4aa6bb-0385-4049-ad5e-eef30aa1dde5 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:12.633387 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-df4aa6bb-0385-4049-ad5e-eef30aa1dde5 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action" status: 200 len: 28216 microversion: 2.1 time: 0.102167 Dec 14 03:23:12.634283 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 530/1033] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:23:12 2021] POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action => generated 28216 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:23:12.772131 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-ac9c0001-ccdb-4086-a2cf-14e016ecb14a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:23:12.773056 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-ac9c0001-ccdb-4086-a2cf-14e016ecb14a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:12.779841 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ac9c0001-ccdb-4086-a2cf-14e016ecb14a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:12.780299 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ac9c0001-ccdb-4086-a2cf-14e016ecb14a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:12.781081 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ac9c0001-ccdb-4086-a2cf-14e016ecb14a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:12.781526 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ac9c0001-ccdb-4086-a2cf-14e016ecb14a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:12.866386 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-ac9c0001-ccdb-4086-a2cf-14e016ecb14a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action" status: 200 len: 28630 microversion: 2.20 time: 0.098793 Dec 14 03:23:12.867053 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 504/1034] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:23:12 2021] POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action => generated 28630 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:23:13.645214 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-303b68c8-81ce-4d35-8b56-e11f085c8ab2 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:23:13.646222 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-303b68c8-81ce-4d35-8b56-e11f085c8ab2 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:13.653069 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-303b68c8-81ce-4d35-8b56-e11f085c8ab2 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:13.653520 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-303b68c8-81ce-4d35-8b56-e11f085c8ab2 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:13.654334 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-303b68c8-81ce-4d35-8b56-e11f085c8ab2 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:13.654775 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-303b68c8-81ce-4d35-8b56-e11f085c8ab2 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:13.765130 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-303b68c8-81ce-4d35-8b56-e11f085c8ab2 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action" status: 200 len: 28216 microversion: 2.1 time: 0.124187 Dec 14 03:23:13.765689 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 531/1035] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:23:13 2021] POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action => generated 28216 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:23:13.878023 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-79fcc2ee-c1a2-4b9b-a391-20a8315122bd tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:23:13.879018 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-79fcc2ee-c1a2-4b9b-a391-20a8315122bd tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:13.885965 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-79fcc2ee-c1a2-4b9b-a391-20a8315122bd tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:13.886410 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-79fcc2ee-c1a2-4b9b-a391-20a8315122bd tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:13.887212 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-79fcc2ee-c1a2-4b9b-a391-20a8315122bd tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:13.887650 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-79fcc2ee-c1a2-4b9b-a391-20a8315122bd tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:13.991734 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-79fcc2ee-c1a2-4b9b-a391-20a8315122bd tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action" status: 200 len: 28630 microversion: 2.20 time: 0.117473 Dec 14 03:23:13.992387 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 505/1036] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:23:13 2021] POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action => generated 28630 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:23:14.776973 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-3e70dfc3-10d0-4198-a9d3-a198fadc5c99 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:23:14.777981 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-3e70dfc3-10d0-4198-a9d3-a198fadc5c99 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:14.784926 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3e70dfc3-10d0-4198-a9d3-a198fadc5c99 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:14.785380 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3e70dfc3-10d0-4198-a9d3-a198fadc5c99 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:14.786161 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3e70dfc3-10d0-4198-a9d3-a198fadc5c99 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:14.786599 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3e70dfc3-10d0-4198-a9d3-a198fadc5c99 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:14.876526 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-3e70dfc3-10d0-4198-a9d3-a198fadc5c99 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action" status: 200 len: 28216 microversion: 2.1 time: 0.102827 Dec 14 03:23:14.876992 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 532/1037] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:23:14 2021] POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action => generated 28216 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:23:15.003753 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-23998971-fc32-4c35-994c-2583e9a3d49f tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:23:15.004758 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-23998971-fc32-4c35-994c-2583e9a3d49f tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:15.011595 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-23998971-fc32-4c35-994c-2583e9a3d49f tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:15.012050 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-23998971-fc32-4c35-994c-2583e9a3d49f tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:15.012833 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-23998971-fc32-4c35-994c-2583e9a3d49f tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:15.013271 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-23998971-fc32-4c35-994c-2583e9a3d49f tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:15.107474 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-23998971-fc32-4c35-994c-2583e9a3d49f tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action" status: 200 len: 28630 microversion: 2.20 time: 0.107632 Dec 14 03:23:15.108100 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 506/1038] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:23:14 2021] POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action => generated 28630 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:23:15.888513 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-e2c64fa3-5391-4548-bd9f-733ea5a44b94 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:23:15.889522 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-e2c64fa3-5391-4548-bd9f-733ea5a44b94 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:15.897099 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e2c64fa3-5391-4548-bd9f-733ea5a44b94 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:15.897551 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e2c64fa3-5391-4548-bd9f-733ea5a44b94 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:15.898331 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e2c64fa3-5391-4548-bd9f-733ea5a44b94 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:15.898776 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e2c64fa3-5391-4548-bd9f-733ea5a44b94 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:15.982811 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-e2c64fa3-5391-4548-bd9f-733ea5a44b94 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action" status: 200 len: 28216 microversion: 2.1 time: 0.098164 Dec 14 03:23:15.983496 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 533/1039] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:23:15 2021] POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action => generated 28216 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:23:16.120089 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-fe057653-e3a5-4844-99cf-ece8ca2bd754 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:23:16.121122 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-fe057653-e3a5-4844-99cf-ece8ca2bd754 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:16.127987 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-fe057653-e3a5-4844-99cf-ece8ca2bd754 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:16.128441 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-fe057653-e3a5-4844-99cf-ece8ca2bd754 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:16.129216 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-fe057653-e3a5-4844-99cf-ece8ca2bd754 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:16.130288 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-fe057653-e3a5-4844-99cf-ece8ca2bd754 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:16.229099 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-fe057653-e3a5-4844-99cf-ece8ca2bd754 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action" status: 200 len: 28630 microversion: 2.20 time: 0.112816 Dec 14 03:23:16.229659 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 507/1040] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:23:16 2021] POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action => generated 28630 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:23:16.995003 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-a9ba9b38-92b9-4b45-b2b4-bc7593e08ceb tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:23:16.996063 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-a9ba9b38-92b9-4b45-b2b4-bc7593e08ceb tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:17.002863 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a9ba9b38-92b9-4b45-b2b4-bc7593e08ceb tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:17.003348 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a9ba9b38-92b9-4b45-b2b4-bc7593e08ceb tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:17.004128 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a9ba9b38-92b9-4b45-b2b4-bc7593e08ceb tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:17.004569 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a9ba9b38-92b9-4b45-b2b4-bc7593e08ceb tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:17.087176 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-a9ba9b38-92b9-4b45-b2b4-bc7593e08ceb tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action" status: 200 len: 28216 microversion: 2.1 time: 0.095968 Dec 14 03:23:17.088090 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 534/1041] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:23:16 2021] POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action => generated 28216 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:23:17.241369 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-8e9d495c-8599-403c-a738-c4965ebbae2b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:23:17.242305 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-8e9d495c-8599-403c-a738-c4965ebbae2b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:17.249384 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-8e9d495c-8599-403c-a738-c4965ebbae2b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:17.249876 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-8e9d495c-8599-403c-a738-c4965ebbae2b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:17.250669 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-8e9d495c-8599-403c-a738-c4965ebbae2b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:17.251146 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-8e9d495c-8599-403c-a738-c4965ebbae2b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:17.332092 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-8e9d495c-8599-403c-a738-c4965ebbae2b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action" status: 200 len: 28630 microversion: 2.20 time: 0.094928 Dec 14 03:23:17.332703 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 508/1042] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:23:17 2021] POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action => generated 28630 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:23:18.098040 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-9adbb7e8-12d1-47e5-bbd1-15113052bb5a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:23:18.099098 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-9adbb7e8-12d1-47e5-bbd1-15113052bb5a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:18.106428 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9adbb7e8-12d1-47e5-bbd1-15113052bb5a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:18.106877 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9adbb7e8-12d1-47e5-bbd1-15113052bb5a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:18.107682 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9adbb7e8-12d1-47e5-bbd1-15113052bb5a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:18.108121 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9adbb7e8-12d1-47e5-bbd1-15113052bb5a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:18.197601 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-9adbb7e8-12d1-47e5-bbd1-15113052bb5a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action" status: 200 len: 28216 microversion: 2.1 time: 0.103370 Dec 14 03:23:18.198229 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 535/1043] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:23:18 2021] POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action => generated 28216 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:23:18.345631 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-add6bcfb-579a-4cf8-8fcf-5e6813518623 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:23:18.346902 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-add6bcfb-579a-4cf8-8fcf-5e6813518623 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:18.354605 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-add6bcfb-579a-4cf8-8fcf-5e6813518623 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:18.355097 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-add6bcfb-579a-4cf8-8fcf-5e6813518623 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:18.355902 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-add6bcfb-579a-4cf8-8fcf-5e6813518623 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:18.356384 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-add6bcfb-579a-4cf8-8fcf-5e6813518623 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:18.447144 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-add6bcfb-579a-4cf8-8fcf-5e6813518623 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action" status: 200 len: 28630 microversion: 2.20 time: 0.106288 Dec 14 03:23:18.447762 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 509/1044] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:23:18 2021] POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action => generated 28630 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:23:19.209028 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-bb544fdc-487f-47f9-8018-b987903dcd28 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:23:19.210032 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-bb544fdc-487f-47f9-8018-b987903dcd28 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:19.216852 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-bb544fdc-487f-47f9-8018-b987903dcd28 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:19.217299 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-bb544fdc-487f-47f9-8018-b987903dcd28 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:19.218075 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-bb544fdc-487f-47f9-8018-b987903dcd28 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:19.218510 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-bb544fdc-487f-47f9-8018-b987903dcd28 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:19.303381 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-bb544fdc-487f-47f9-8018-b987903dcd28 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action" status: 200 len: 28216 microversion: 2.1 time: 0.097669 Dec 14 03:23:19.304005 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 536/1045] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:23:19 2021] POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action => generated 28216 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:23:19.458052 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-27021789-d56c-4aeb-9da1-2aa20afc7067 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:23:19.459068 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-27021789-d56c-4aeb-9da1-2aa20afc7067 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:19.465915 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-27021789-d56c-4aeb-9da1-2aa20afc7067 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:19.466362 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-27021789-d56c-4aeb-9da1-2aa20afc7067 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:19.467164 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-27021789-d56c-4aeb-9da1-2aa20afc7067 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:19.467633 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-27021789-d56c-4aeb-9da1-2aa20afc7067 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:19.558013 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-27021789-d56c-4aeb-9da1-2aa20afc7067 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action" status: 200 len: 28630 microversion: 2.20 time: 0.103845 Dec 14 03:23:19.558670 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 510/1046] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:23:19 2021] POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action => generated 28630 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:23:20.315398 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-c964655a-4867-413b-95a6-09b9d17fe30b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:23:20.316409 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-c964655a-4867-413b-95a6-09b9d17fe30b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:20.323904 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c964655a-4867-413b-95a6-09b9d17fe30b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:20.324358 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c964655a-4867-413b-95a6-09b9d17fe30b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:20.325141 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c964655a-4867-413b-95a6-09b9d17fe30b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:20.325581 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c964655a-4867-413b-95a6-09b9d17fe30b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:20.422903 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-c964655a-4867-413b-95a6-09b9d17fe30b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action" status: 200 len: 28216 microversion: 2.1 time: 0.111340 Dec 14 03:23:20.423492 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 537/1047] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:23:20 2021] POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action => generated 28216 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:23:20.570998 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-1d1e0fe5-3cbd-43a8-9d02-33dbfff27898 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:23:20.572048 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-1d1e0fe5-3cbd-43a8-9d02-33dbfff27898 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:20.578880 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-1d1e0fe5-3cbd-43a8-9d02-33dbfff27898 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:20.579392 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-1d1e0fe5-3cbd-43a8-9d02-33dbfff27898 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:20.580182 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-1d1e0fe5-3cbd-43a8-9d02-33dbfff27898 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:20.580627 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-1d1e0fe5-3cbd-43a8-9d02-33dbfff27898 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:20.660994 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-1d1e0fe5-3cbd-43a8-9d02-33dbfff27898 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action" status: 200 len: 28630 microversion: 2.20 time: 0.094685 Dec 14 03:23:20.661632 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 511/1048] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:23:20 2021] POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action => generated 28630 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:23:21.434750 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-c6b9d822-283b-4e0a-bf25-5bb8cb86ad17 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:23:21.435881 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-c6b9d822-283b-4e0a-bf25-5bb8cb86ad17 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:21.442639 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c6b9d822-283b-4e0a-bf25-5bb8cb86ad17 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:21.443176 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c6b9d822-283b-4e0a-bf25-5bb8cb86ad17 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:21.443992 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c6b9d822-283b-4e0a-bf25-5bb8cb86ad17 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:21.444427 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c6b9d822-283b-4e0a-bf25-5bb8cb86ad17 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:21.543662 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-c6b9d822-283b-4e0a-bf25-5bb8cb86ad17 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action" status: 200 len: 28216 microversion: 2.1 time: 0.112775 Dec 14 03:23:21.544318 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 538/1049] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:23:21 2021] POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action => generated 28216 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:23:21.673249 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-ca28b772-d190-4632-b4a8-b4c3899e63d6 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:23:21.674328 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-ca28b772-d190-4632-b4a8-b4c3899e63d6 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:21.681217 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ca28b772-d190-4632-b4a8-b4c3899e63d6 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:21.681673 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ca28b772-d190-4632-b4a8-b4c3899e63d6 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:21.682464 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ca28b772-d190-4632-b4a8-b4c3899e63d6 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:21.682906 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ca28b772-d190-4632-b4a8-b4c3899e63d6 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:21.780363 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-ca28b772-d190-4632-b4a8-b4c3899e63d6 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action" status: 200 len: 28630 microversion: 2.20 time: 0.111060 Dec 14 03:23:21.780917 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 512/1050] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:23:21 2021] POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action => generated 28630 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:23:22.556357 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-c4c1bd26-8dd3-4c0f-8905-26fa8487f52f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:23:22.557264 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-c4c1bd26-8dd3-4c0f-8905-26fa8487f52f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:22.564609 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c4c1bd26-8dd3-4c0f-8905-26fa8487f52f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:22.564609 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c4c1bd26-8dd3-4c0f-8905-26fa8487f52f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:22.565293 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c4c1bd26-8dd3-4c0f-8905-26fa8487f52f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:22.565725 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c4c1bd26-8dd3-4c0f-8905-26fa8487f52f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:22.647092 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-c4c1bd26-8dd3-4c0f-8905-26fa8487f52f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action" status: 200 len: 28216 microversion: 2.1 time: 0.095203 Dec 14 03:23:22.647758 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 539/1051] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:23:22 2021] POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action => generated 28216 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:23:22.793227 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-97abd96f-8505-47c9-986d-1685c3d8b9b0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:23:22.794299 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-97abd96f-8505-47c9-986d-1685c3d8b9b0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:22.801113 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-97abd96f-8505-47c9-986d-1685c3d8b9b0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:22.801573 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-97abd96f-8505-47c9-986d-1685c3d8b9b0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:22.802381 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-97abd96f-8505-47c9-986d-1685c3d8b9b0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:22.802809 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-97abd96f-8505-47c9-986d-1685c3d8b9b0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:22.886426 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-97abd96f-8505-47c9-986d-1685c3d8b9b0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action" status: 200 len: 28630 microversion: 2.20 time: 0.097124 Dec 14 03:23:22.887096 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 513/1052] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:23:22 2021] POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action => generated 28630 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:23:23.658219 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-e0d65b67-6323-445d-9299-37826cdb7294 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:23:23.659267 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-e0d65b67-6323-445d-9299-37826cdb7294 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:23.666706 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e0d65b67-6323-445d-9299-37826cdb7294 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:23.667188 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e0d65b67-6323-445d-9299-37826cdb7294 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:23.667980 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e0d65b67-6323-445d-9299-37826cdb7294 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:23.668420 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e0d65b67-6323-445d-9299-37826cdb7294 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:23.752028 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-e0d65b67-6323-445d-9299-37826cdb7294 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action" status: 200 len: 28216 microversion: 2.1 time: 0.097803 Dec 14 03:23:23.752642 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 540/1053] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:23:23 2021] POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action => generated 28216 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:23:23.899257 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-ce0a1a8c-f893-4280-9c0a-babe8a9096c3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:23:23.900229 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-ce0a1a8c-f893-4280-9c0a-babe8a9096c3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:23.907051 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ce0a1a8c-f893-4280-9c0a-babe8a9096c3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:23.907519 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ce0a1a8c-f893-4280-9c0a-babe8a9096c3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:23.908307 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ce0a1a8c-f893-4280-9c0a-babe8a9096c3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:23.908751 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ce0a1a8c-f893-4280-9c0a-babe8a9096c3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:23.992116 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-ce0a1a8c-f893-4280-9c0a-babe8a9096c3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action" status: 200 len: 28630 microversion: 2.20 time: 0.097402 Dec 14 03:23:23.993497 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 514/1054] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:23:23 2021] POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action => generated 28630 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:23:24.411493 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-5a89eec5-0585-423f-bb1d-252810ac49d3 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1787306076", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-801497898", "security_groups": [{"name": "tempest-secgroup-smoke-201763541"}], "block_device_mapping_v2": [{"uuid": "0488d391-782f-4a4f-b546-61da8a4b8f65", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8f2d77d5-e58c-4a97-8899-5e1a2da29f69"}]}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:23:24.518087 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.network.neutron [None req-5a89eec5-0585-423f-bb1d-252810ac49d3 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] validate_networks() for [('8f2d77d5-e58c-4a97-8899-5e1a2da29f69', None, None, None, None, None)] {{(pid=116072) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 14 03:23:24.764107 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-7f97700c-a093-43e9-a036-92177bad0f24 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:23:24.765119 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-7f97700c-a093-43e9-a036-92177bad0f24 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:24.772440 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-7f97700c-a093-43e9-a036-92177bad0f24 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:24.772881 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-7f97700c-a093-43e9-a036-92177bad0f24 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:24.773667 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-7f97700c-a093-43e9-a036-92177bad0f24 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:24.774107 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-7f97700c-a093-43e9-a036-92177bad0f24 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:24.856031 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-7f97700c-a093-43e9-a036-92177bad0f24 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action" status: 200 len: 28216 microversion: 2.1 time: 0.095660 Dec 14 03:23:24.856606 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 515/1055] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:23:24 2021] POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action => generated 28216 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 14 03:23:25.004704 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-428c757c-5456-46ca-bc7c-b8ce6359f89d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:23:25.006291 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-428c757c-5456-46ca-bc7c-b8ce6359f89d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:25.013356 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-428c757c-5456-46ca-bc7c-b8ce6359f89d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:25.013846 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-428c757c-5456-46ca-bc7c-b8ce6359f89d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:25.014651 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-428c757c-5456-46ca-bc7c-b8ce6359f89d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:25.015126 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-428c757c-5456-46ca-bc7c-b8ce6359f89d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:25.097085 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-428c757c-5456-46ca-bc7c-b8ce6359f89d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action" status: 200 len: 28630 microversion: 2.20 time: 0.096429 Dec 14 03:23:25.101096 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 516/1056] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:23:24 2021] POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action => generated 28630 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 14 03:23:25.106976 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-5a89eec5-0585-423f-bb1d-252810ac49d3 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Flavor limits 0:0:0 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 14 03:23:25.107481 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-5a89eec5-0585-423f-bb1d-252810ac49d3 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Image limits 0:0:0 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 14 03:23:25.107812 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-5a89eec5-0585-423f-bb1d-252810ac49d3 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Flavor pref 0:0:0 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 14 03:23:25.108219 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-5a89eec5-0585-423f-bb1d-252810ac49d3 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Image pref 0:0:0 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 14 03:23:25.108631 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-5a89eec5-0585-423f-bb1d-252810ac49d3 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 14 03:23:25.117849 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5a89eec5-0585-423f-bb1d-252810ac49d3 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:25.118298 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5a89eec5-0585-423f-bb1d-252810ac49d3 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:25.119145 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5a89eec5-0585-423f-bb1d-252810ac49d3 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:25.119582 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5a89eec5-0585-423f-bb1d-252810ac49d3 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:25.135893 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.quota [None req-5a89eec5-0585-423f-bb1d-252810ac49d3 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Getting quotas for project d0c4dcf4957d42b896f04f682afeef7b. Resources: {'cores', 'instances', 'ram'} {{(pid=116072) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 03:23:25.139753 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.quota [None req-5a89eec5-0585-423f-bb1d-252810ac49d3 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Getting quotas for user bf869873369f496e9e25a6d6b2a7ba86 and project d0c4dcf4957d42b896f04f682afeef7b. Resources: {'cores', 'instances', 'ram'} {{(pid=116072) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 03:23:25.192061 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-5a89eec5-0585-423f-bb1d-252810ac49d3 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Going to run 1 instances... {{(pid=116072) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 14 03:23:25.194939 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-5a89eec5-0585-423f-bb1d-252810ac49d3 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] [instance: 76d36b1d-a395-46b5-b80d-9fa1871c0873] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0488d391-782f-4a4f-b546-61da8a4b8f65',volume_size=None,volume_type=None)] {{(pid=116072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 14 03:23:25.316912 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-5a89eec5-0585-423f-bb1d-252810ac49d3 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.909438 Dec 14 03:23:25.317546 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 541/1057] 10.222.0.43 () {60 vars in 1146 bytes} [Tue Dec 14 03:23:24 2021] POST /compute/v2.1/servers => generated 405 bytes in 911 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 14 03:23:25.328168 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-5945bc88-e920-4e9a-ad22-c0517121a179 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:23:25.328875 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-5945bc88-e920-4e9a-ad22-c0517121a179 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] [instance: 76d36b1d-a395-46b5-b80d-9fa1871c0873] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:25.383170 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-5945bc88-e920-4e9a-ad22-c0517121a179 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf869873369f496e9e25a6d6b2a7ba86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:23:25.389605 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-5945bc88-e920-4e9a-ad22-c0517121a179 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /compute/v2.1/servers/76d36b1d-a395-46b5-b80d-9fa1871c0873" status: 200 len: 1094 microversion: 2.1 time: 0.065375 Dec 14 03:23:25.390349 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 517/1058] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:23:25 2021] GET /compute/v2.1/servers/76d36b1d-a395-46b5-b80d-9fa1871c0873 => generated 1094 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:23:25.868911 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-bd8e2cf8-6c39-4a61-8175-f4e9b62a718b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:23:25.869969 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-bd8e2cf8-6c39-4a61-8175-f4e9b62a718b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:25.876473 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-bd8e2cf8-6c39-4a61-8175-f4e9b62a718b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:25.876864 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-bd8e2cf8-6c39-4a61-8175-f4e9b62a718b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:25.877849 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-bd8e2cf8-6c39-4a61-8175-f4e9b62a718b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:25.878444 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-bd8e2cf8-6c39-4a61-8175-f4e9b62a718b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:25.989700 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-bd8e2cf8-6c39-4a61-8175-f4e9b62a718b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action" status: 200 len: 28216 microversion: 2.1 time: 0.125200 Dec 14 03:23:25.990960 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 542/1059] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:23:25 2021] POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action => generated 28216 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:23:26.108668 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-711d12ab-db2b-4531-b2aa-62ef02b6e249 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:23:26.109604 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-711d12ab-db2b-4531-b2aa-62ef02b6e249 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:26.116810 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-711d12ab-db2b-4531-b2aa-62ef02b6e249 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:26.117270 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-711d12ab-db2b-4531-b2aa-62ef02b6e249 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:26.118062 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-711d12ab-db2b-4531-b2aa-62ef02b6e249 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:26.118508 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-711d12ab-db2b-4531-b2aa-62ef02b6e249 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:26.206020 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-711d12ab-db2b-4531-b2aa-62ef02b6e249 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action" status: 200 len: 28630 microversion: 2.20 time: 0.100882 Dec 14 03:23:26.206659 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 518/1060] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:23:26 2021] POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action => generated 28630 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:23:26.407067 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-28c84fd4-c4c6-4073-89dc-5082941680f0 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:23:26.407702 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-28c84fd4-c4c6-4073-89dc-5082941680f0 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] [instance: 76d36b1d-a395-46b5-b80d-9fa1871c0873] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:26.415123 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-28c84fd4-c4c6-4073-89dc-5082941680f0 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:26.415581 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-28c84fd4-c4c6-4073-89dc-5082941680f0 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:26.416360 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-28c84fd4-c4c6-4073-89dc-5082941680f0 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:26.416802 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-28c84fd4-c4c6-4073-89dc-5082941680f0 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:26.480717 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-28c84fd4-c4c6-4073-89dc-5082941680f0 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf869873369f496e9e25a6d6b2a7ba86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:23:26.488586 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-28c84fd4-c4c6-4073-89dc-5082941680f0 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /compute/v2.1/servers/76d36b1d-a395-46b5-b80d-9fa1871c0873" status: 200 len: 1192 microversion: 2.1 time: 0.085598 Dec 14 03:23:26.489144 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 543/1061] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:23:26 2021] GET /compute/v2.1/servers/76d36b1d-a395-46b5-b80d-9fa1871c0873 => generated 1192 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:23:27.003820 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-33e07ea2-385a-478d-b9d0-54af4405ee5e tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:23:27.004780 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-33e07ea2-385a-478d-b9d0-54af4405ee5e tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:27.013075 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-33e07ea2-385a-478d-b9d0-54af4405ee5e tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:27.013911 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-33e07ea2-385a-478d-b9d0-54af4405ee5e tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:27.014794 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-33e07ea2-385a-478d-b9d0-54af4405ee5e tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:27.015263 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-33e07ea2-385a-478d-b9d0-54af4405ee5e tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:27.113975 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-33e07ea2-385a-478d-b9d0-54af4405ee5e tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action" status: 200 len: 28216 microversion: 2.1 time: 0.114906 Dec 14 03:23:27.114605 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 519/1062] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:23:26 2021] POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action => generated 28216 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:23:27.217712 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-60c50125-acfe-44a5-8b13-f2877dd2c125 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:23:27.218664 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-60c50125-acfe-44a5-8b13-f2877dd2c125 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:27.224988 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-60c50125-acfe-44a5-8b13-f2877dd2c125 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:27.225435 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-60c50125-acfe-44a5-8b13-f2877dd2c125 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:27.226227 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-60c50125-acfe-44a5-8b13-f2877dd2c125 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:27.226837 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-60c50125-acfe-44a5-8b13-f2877dd2c125 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:27.317852 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-60c50125-acfe-44a5-8b13-f2877dd2c125 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action" status: 200 len: 28630 microversion: 2.20 time: 0.103592 Dec 14 03:23:27.322693 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 544/1063] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:23:27 2021] POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action => generated 28630 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 14 03:23:27.507519 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-dd984545-c434-43dd-86b5-6cdc4ef125c6 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:23:27.508168 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-dd984545-c434-43dd-86b5-6cdc4ef125c6 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] [instance: 76d36b1d-a395-46b5-b80d-9fa1871c0873] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:27.515297 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-dd984545-c434-43dd-86b5-6cdc4ef125c6 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:27.515756 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-dd984545-c434-43dd-86b5-6cdc4ef125c6 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:27.516746 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-dd984545-c434-43dd-86b5-6cdc4ef125c6 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:27.517223 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-dd984545-c434-43dd-86b5-6cdc4ef125c6 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:27.651511 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-dd984545-c434-43dd-86b5-6cdc4ef125c6 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf869873369f496e9e25a6d6b2a7ba86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:23:27.659027 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-dd984545-c434-43dd-86b5-6cdc4ef125c6 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /compute/v2.1/servers/76d36b1d-a395-46b5-b80d-9fa1871c0873" status: 200 len: 1265 microversion: 2.1 time: 0.156611 Dec 14 03:23:27.659645 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 520/1064] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:23:27 2021] GET /compute/v2.1/servers/76d36b1d-a395-46b5-b80d-9fa1871c0873 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:23:27.966064 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [req-f5c1b544-86a4-4f9c-8a18-5369d758bebc req-6c4dffb6-899a-4976-9b03-a2e34603e2ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76d36b1d-a395-46b5-b80d-9fa1871c0873", "tag": "ee1b94f1-9b24-4f43-ae74-a354e91e38f1"}]} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:23:27.968734 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:23:27.968734 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: warnings.warn(msg) Dec 14 03:23:27.983802 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-f5c1b544-86a4-4f9c-8a18-5369d758bebc req-6c4dffb6-899a-4976-9b03-a2e34603e2ec service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:27.984250 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-f5c1b544-86a4-4f9c-8a18-5369d758bebc req-6c4dffb6-899a-4976-9b03-a2e34603e2ec service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:28.004104 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.compute.server_external_events [req-f5c1b544-86a4-4f9c-8a18-5369d758bebc req-6c4dffb6-899a-4976-9b03-a2e34603e2ec service nova] Creating event network-changed:ee1b94f1-9b24-4f43-ae74-a354e91e38f1 for instance 76d36b1d-a395-46b5-b80d-9fa1871c0873 on hv-cinder-81803 Dec 14 03:23:28.009256 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [req-f5c1b544-86a4-4f9c-8a18-5369d758bebc req-6c4dffb6-899a-4976-9b03-a2e34603e2ec service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053864 Dec 14 03:23:28.009846 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 545/1065] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Dec 14 03:23:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:23:28.125563 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-1c1f6619-0ac6-4287-898f-95387d5637de tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:23:28.126491 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-1c1f6619-0ac6-4287-898f-95387d5637de tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:28.133661 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-1c1f6619-0ac6-4287-898f-95387d5637de tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:28.134119 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-1c1f6619-0ac6-4287-898f-95387d5637de tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:28.134912 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-1c1f6619-0ac6-4287-898f-95387d5637de tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:28.135386 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-1c1f6619-0ac6-4287-898f-95387d5637de tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:28.222125 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-1c1f6619-0ac6-4287-898f-95387d5637de tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action" status: 200 len: 28216 microversion: 2.1 time: 0.100070 Dec 14 03:23:28.222804 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 521/1066] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:23:28 2021] POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action => generated 28216 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:23:28.330658 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-31e26b8f-6604-47b9-a870-15a168ffcac7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:23:28.331683 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-31e26b8f-6604-47b9-a870-15a168ffcac7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:28.337893 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-31e26b8f-6604-47b9-a870-15a168ffcac7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:28.338359 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-31e26b8f-6604-47b9-a870-15a168ffcac7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:28.339178 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-31e26b8f-6604-47b9-a870-15a168ffcac7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:28.339791 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-31e26b8f-6604-47b9-a870-15a168ffcac7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:28.422105 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-31e26b8f-6604-47b9-a870-15a168ffcac7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action" status: 200 len: 28630 microversion: 2.20 time: 0.095729 Dec 14 03:23:28.423024 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 546/1067] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:23:28 2021] POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action => generated 28630 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:23:28.677122 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-21d4b806-41b8-41e8-ab92-593ca7ccb31a tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:23:28.678437 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-21d4b806-41b8-41e8-ab92-593ca7ccb31a tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] [instance: 76d36b1d-a395-46b5-b80d-9fa1871c0873] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:28.685422 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-21d4b806-41b8-41e8-ab92-593ca7ccb31a tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:28.685878 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-21d4b806-41b8-41e8-ab92-593ca7ccb31a tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:28.686667 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-21d4b806-41b8-41e8-ab92-593ca7ccb31a tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:28.687144 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-21d4b806-41b8-41e8-ab92-593ca7ccb31a tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:28.821788 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-21d4b806-41b8-41e8-ab92-593ca7ccb31a tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf869873369f496e9e25a6d6b2a7ba86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:23:28.829236 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-21d4b806-41b8-41e8-ab92-593ca7ccb31a tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /compute/v2.1/servers/76d36b1d-a395-46b5-b80d-9fa1871c0873" status: 200 len: 1265 microversion: 2.1 time: 0.156137 Dec 14 03:23:28.829750 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 522/1068] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:23:28 2021] GET /compute/v2.1/servers/76d36b1d-a395-46b5-b80d-9fa1871c0873 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 03:23:29.234389 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-d323560f-5201-4ff1-bf7f-aa5792216257 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:23:29.235334 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-d323560f-5201-4ff1-bf7f-aa5792216257 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:29.242354 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d323560f-5201-4ff1-bf7f-aa5792216257 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:29.242804 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d323560f-5201-4ff1-bf7f-aa5792216257 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:29.243610 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d323560f-5201-4ff1-bf7f-aa5792216257 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:29.244047 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d323560f-5201-4ff1-bf7f-aa5792216257 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:29.401093 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-d323560f-5201-4ff1-bf7f-aa5792216257 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action" status: 200 len: 28216 microversion: 2.1 time: 0.170594 Dec 14 03:23:29.404985 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 547/1069] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:23:29 2021] POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action => generated 28216 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:23:29.433736 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-56c17af1-779d-41fd-a733-e733e64ad93e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:23:29.434662 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-56c17af1-779d-41fd-a733-e733e64ad93e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:29.440935 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-56c17af1-779d-41fd-a733-e733e64ad93e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:29.441390 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-56c17af1-779d-41fd-a733-e733e64ad93e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:29.442172 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-56c17af1-779d-41fd-a733-e733e64ad93e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:29.442615 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-56c17af1-779d-41fd-a733-e733e64ad93e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:29.530936 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-56c17af1-779d-41fd-a733-e733e64ad93e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action" status: 200 len: 28630 microversion: 2.20 time: 0.100725 Dec 14 03:23:29.531766 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 523/1070] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:23:29 2021] POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action => generated 28630 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:23:29.846359 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-a43ec8f2-fc95-4d24-8f1f-a37e5b1f31bd tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:23:29.847059 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-a43ec8f2-fc95-4d24-8f1f-a37e5b1f31bd tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] [instance: 76d36b1d-a395-46b5-b80d-9fa1871c0873] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:29.854497 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a43ec8f2-fc95-4d24-8f1f-a37e5b1f31bd tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:29.854943 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a43ec8f2-fc95-4d24-8f1f-a37e5b1f31bd tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:29.855758 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a43ec8f2-fc95-4d24-8f1f-a37e5b1f31bd tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:29.856190 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a43ec8f2-fc95-4d24-8f1f-a37e5b1f31bd tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:29.984993 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-a43ec8f2-fc95-4d24-8f1f-a37e5b1f31bd tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf869873369f496e9e25a6d6b2a7ba86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:23:29.992961 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-a43ec8f2-fc95-4d24-8f1f-a37e5b1f31bd tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /compute/v2.1/servers/76d36b1d-a395-46b5-b80d-9fa1871c0873" status: 200 len: 1265 microversion: 2.1 time: 0.150678 Dec 14 03:23:29.993520 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 548/1071] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:23:29 2021] GET /compute/v2.1/servers/76d36b1d-a395-46b5-b80d-9fa1871c0873 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:23:30.413171 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-673b5367-e5d7-4044-bab3-b3254bcd4a13 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:23:30.414180 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-673b5367-e5d7-4044-bab3-b3254bcd4a13 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:30.421023 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-673b5367-e5d7-4044-bab3-b3254bcd4a13 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:30.421477 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-673b5367-e5d7-4044-bab3-b3254bcd4a13 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:30.422261 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-673b5367-e5d7-4044-bab3-b3254bcd4a13 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:30.422703 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-673b5367-e5d7-4044-bab3-b3254bcd4a13 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:30.515440 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-673b5367-e5d7-4044-bab3-b3254bcd4a13 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action" status: 200 len: 28507 microversion: 2.1 time: 0.106183 Dec 14 03:23:30.516106 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 524/1072] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:23:30 2021] POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action => generated 28507 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:23:30.541564 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-1063c747-5147-473a-836d-6d610c2fdbdb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:23:30.542478 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-1063c747-5147-473a-836d-6d610c2fdbdb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:30.548709 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1063c747-5147-473a-836d-6d610c2fdbdb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:30.549155 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1063c747-5147-473a-836d-6d610c2fdbdb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:30.549923 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1063c747-5147-473a-836d-6d610c2fdbdb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:30.550354 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1063c747-5147-473a-836d-6d610c2fdbdb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:30.631495 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-1063c747-5147-473a-836d-6d610c2fdbdb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action" status: 200 len: 28630 microversion: 2.20 time: 0.092724 Dec 14 03:23:30.632058 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 549/1073] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:23:30 2021] POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action => generated 28630 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:23:31.010314 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-23b55d72-fc3d-4e27-a7ff-069d906a6ace tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:23:31.011021 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-23b55d72-fc3d-4e27-a7ff-069d906a6ace tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] [instance: 76d36b1d-a395-46b5-b80d-9fa1871c0873] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:31.018025 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-23b55d72-fc3d-4e27-a7ff-069d906a6ace tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:31.018487 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-23b55d72-fc3d-4e27-a7ff-069d906a6ace tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:31.019329 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-23b55d72-fc3d-4e27-a7ff-069d906a6ace tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:31.019777 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-23b55d72-fc3d-4e27-a7ff-069d906a6ace tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:31.151738 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-23b55d72-fc3d-4e27-a7ff-069d906a6ace tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf869873369f496e9e25a6d6b2a7ba86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:23:31.159417 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-23b55d72-fc3d-4e27-a7ff-069d906a6ace tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /compute/v2.1/servers/76d36b1d-a395-46b5-b80d-9fa1871c0873" status: 200 len: 1265 microversion: 2.1 time: 0.153582 Dec 14 03:23:31.159977 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 525/1074] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:23:31 2021] GET /compute/v2.1/servers/76d36b1d-a395-46b5-b80d-9fa1871c0873 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:23:31.527844 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-959c031a-976e-4cab-aeec-985255c6e139 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:23:31.528839 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-959c031a-976e-4cab-aeec-985255c6e139 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:31.535725 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-959c031a-976e-4cab-aeec-985255c6e139 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:31.536177 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-959c031a-976e-4cab-aeec-985255c6e139 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:31.536961 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-959c031a-976e-4cab-aeec-985255c6e139 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:31.537398 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-959c031a-976e-4cab-aeec-985255c6e139 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:31.625827 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-959c031a-976e-4cab-aeec-985255c6e139 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action" status: 200 len: 28507 microversion: 2.1 time: 0.101821 Dec 14 03:23:31.626460 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 550/1075] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:23:31 2021] POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action => generated 28507 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:23:31.642712 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-ddaae579-01a0-4b72-9e4b-9fdb5aac1780 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:23:31.643667 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-ddaae579-01a0-4b72-9e4b-9fdb5aac1780 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:31.650606 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ddaae579-01a0-4b72-9e4b-9fdb5aac1780 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:31.651140 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ddaae579-01a0-4b72-9e4b-9fdb5aac1780 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:31.651931 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ddaae579-01a0-4b72-9e4b-9fdb5aac1780 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:31.652373 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ddaae579-01a0-4b72-9e4b-9fdb5aac1780 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:31.757784 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-ddaae579-01a0-4b72-9e4b-9fdb5aac1780 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action" status: 200 len: 28989 microversion: 2.20 time: 0.118572 Dec 14 03:23:31.758410 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 526/1076] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:23:31 2021] POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action => generated 28989 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:23:32.176279 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-5e0b725f-293e-4308-876c-b094c401ed82 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:23:32.176900 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-5e0b725f-293e-4308-876c-b094c401ed82 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] [instance: 76d36b1d-a395-46b5-b80d-9fa1871c0873] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:32.183807 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5e0b725f-293e-4308-876c-b094c401ed82 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:32.184259 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5e0b725f-293e-4308-876c-b094c401ed82 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:32.185027 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5e0b725f-293e-4308-876c-b094c401ed82 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:32.185461 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5e0b725f-293e-4308-876c-b094c401ed82 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:32.312783 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-5e0b725f-293e-4308-876c-b094c401ed82 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf869873369f496e9e25a6d6b2a7ba86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:23:32.321064 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-5e0b725f-293e-4308-876c-b094c401ed82 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /compute/v2.1/servers/76d36b1d-a395-46b5-b80d-9fa1871c0873" status: 200 len: 1265 microversion: 2.1 time: 0.148853 Dec 14 03:23:32.321613 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 551/1077] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:23:32 2021] GET /compute/v2.1/servers/76d36b1d-a395-46b5-b80d-9fa1871c0873 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:23:32.638518 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-cbd41e2c-9107-4f80-a117-1af32756088f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:23:32.639543 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-cbd41e2c-9107-4f80-a117-1af32756088f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:32.646273 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-cbd41e2c-9107-4f80-a117-1af32756088f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:32.646857 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-cbd41e2c-9107-4f80-a117-1af32756088f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:32.647496 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-cbd41e2c-9107-4f80-a117-1af32756088f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:32.647931 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-cbd41e2c-9107-4f80-a117-1af32756088f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:32.744130 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-cbd41e2c-9107-4f80-a117-1af32756088f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action" status: 200 len: 28675 microversion: 2.1 time: 0.109787 Dec 14 03:23:32.744773 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 527/1078] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:23:32 2021] POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action => generated 28675 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:23:32.768560 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-24a063ce-7dda-4145-b3bc-7dcb23e83e9d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:23:32.769479 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-24a063ce-7dda-4145-b3bc-7dcb23e83e9d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:32.775804 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-24a063ce-7dda-4145-b3bc-7dcb23e83e9d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:32.776261 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-24a063ce-7dda-4145-b3bc-7dcb23e83e9d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:32.777044 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-24a063ce-7dda-4145-b3bc-7dcb23e83e9d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:32.777483 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-24a063ce-7dda-4145-b3bc-7dcb23e83e9d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:32.877325 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-24a063ce-7dda-4145-b3bc-7dcb23e83e9d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action" status: 200 len: 31197 microversion: 2.20 time: 0.112142 Dec 14 03:23:32.877874 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 552/1079] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:23:32 2021] POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action => generated 31197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:23:33.338499 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-f3b274a2-0ace-4991-99a5-ec4a3b683eeb tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:23:33.339218 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-f3b274a2-0ace-4991-99a5-ec4a3b683eeb tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] [instance: 76d36b1d-a395-46b5-b80d-9fa1871c0873] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:33.346085 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-f3b274a2-0ace-4991-99a5-ec4a3b683eeb tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:33.346532 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-f3b274a2-0ace-4991-99a5-ec4a3b683eeb tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:33.347340 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-f3b274a2-0ace-4991-99a5-ec4a3b683eeb tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:33.347779 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-f3b274a2-0ace-4991-99a5-ec4a3b683eeb tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:33.480114 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-f3b274a2-0ace-4991-99a5-ec4a3b683eeb tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf869873369f496e9e25a6d6b2a7ba86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:23:33.487253 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-f3b274a2-0ace-4991-99a5-ec4a3b683eeb tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /compute/v2.1/servers/76d36b1d-a395-46b5-b80d-9fa1871c0873" status: 200 len: 1265 microversion: 2.1 time: 0.153245 Dec 14 03:23:33.488063 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 528/1080] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:23:33 2021] GET /compute/v2.1/servers/76d36b1d-a395-46b5-b80d-9fa1871c0873 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:23:33.756460 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-187722c4-8bff-4d80-9418-84f5f33191eb tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:23:33.757453 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-187722c4-8bff-4d80-9418-84f5f33191eb tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:33.764284 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-187722c4-8bff-4d80-9418-84f5f33191eb tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:33.765348 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-187722c4-8bff-4d80-9418-84f5f33191eb tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:33.766125 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-187722c4-8bff-4d80-9418-84f5f33191eb tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:33.766560 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-187722c4-8bff-4d80-9418-84f5f33191eb tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:33.855555 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-187722c4-8bff-4d80-9418-84f5f33191eb tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action" status: 200 len: 28675 microversion: 2.1 time: 0.103493 Dec 14 03:23:33.856252 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 553/1081] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:23:33 2021] POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action => generated 28675 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:23:33.889869 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-bf54b48d-1b8d-494c-a481-3b035a78de94 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:23:33.890791 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-bf54b48d-1b8d-494c-a481-3b035a78de94 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:33.897656 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-bf54b48d-1b8d-494c-a481-3b035a78de94 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:33.898112 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-bf54b48d-1b8d-494c-a481-3b035a78de94 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:33.898928 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-bf54b48d-1b8d-494c-a481-3b035a78de94 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:33.899398 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-bf54b48d-1b8d-494c-a481-3b035a78de94 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:33.987935 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-bf54b48d-1b8d-494c-a481-3b035a78de94 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action" status: 200 len: 33046 microversion: 2.20 time: 0.101275 Dec 14 03:23:33.988489 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 529/1082] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:23:33 2021] POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action => generated 33046 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:23:34.504556 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-7d7d8a13-ac34-4c50-af8b-1d91aa6619a9 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:23:34.505254 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-7d7d8a13-ac34-4c50-af8b-1d91aa6619a9 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] [instance: 76d36b1d-a395-46b5-b80d-9fa1871c0873] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:34.512547 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7d7d8a13-ac34-4c50-af8b-1d91aa6619a9 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:34.512993 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7d7d8a13-ac34-4c50-af8b-1d91aa6619a9 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:34.513758 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7d7d8a13-ac34-4c50-af8b-1d91aa6619a9 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:34.514189 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7d7d8a13-ac34-4c50-af8b-1d91aa6619a9 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:34.642063 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-7d7d8a13-ac34-4c50-af8b-1d91aa6619a9 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf869873369f496e9e25a6d6b2a7ba86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:23:34.650286 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-7d7d8a13-ac34-4c50-af8b-1d91aa6619a9 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /compute/v2.1/servers/76d36b1d-a395-46b5-b80d-9fa1871c0873" status: 200 len: 1265 microversion: 2.1 time: 0.149780 Dec 14 03:23:34.650845 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 554/1083] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:23:34 2021] GET /compute/v2.1/servers/76d36b1d-a395-46b5-b80d-9fa1871c0873 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:23:34.868284 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-2bb8436d-5498-4599-8c10-c5a795c3691a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:23:34.869286 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-2bb8436d-5498-4599-8c10-c5a795c3691a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:34.876108 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-2bb8436d-5498-4599-8c10-c5a795c3691a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:34.876556 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-2bb8436d-5498-4599-8c10-c5a795c3691a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:34.877323 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-2bb8436d-5498-4599-8c10-c5a795c3691a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:34.877759 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-2bb8436d-5498-4599-8c10-c5a795c3691a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:34.993182 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-2bb8436d-5498-4599-8c10-c5a795c3691a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action" status: 200 len: 28675 microversion: 2.1 time: 0.129306 Dec 14 03:23:34.993835 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 530/1084] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:23:34 2021] POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action => generated 28675 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:23:34.999256 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-dc9856bb-4af5-41ff-b649-9776242005f7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:23:35.000173 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-dc9856bb-4af5-41ff-b649-9776242005f7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:35.007029 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-dc9856bb-4af5-41ff-b649-9776242005f7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:35.007497 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-dc9856bb-4af5-41ff-b649-9776242005f7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:35.008279 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-dc9856bb-4af5-41ff-b649-9776242005f7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:35.008715 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-dc9856bb-4af5-41ff-b649-9776242005f7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:35.108889 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-dc9856bb-4af5-41ff-b649-9776242005f7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action" status: 200 len: 33991 microversion: 2.20 time: 0.113099 Dec 14 03:23:35.109638 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 555/1085] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:23:34 2021] POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action => generated 33991 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:23:35.667738 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-325324d8-51b6-4910-8bec-e10458322ed0 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:23:35.668442 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-325324d8-51b6-4910-8bec-e10458322ed0 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] [instance: 76d36b1d-a395-46b5-b80d-9fa1871c0873] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:35.675375 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-325324d8-51b6-4910-8bec-e10458322ed0 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:35.675825 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-325324d8-51b6-4910-8bec-e10458322ed0 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:35.676595 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-325324d8-51b6-4910-8bec-e10458322ed0 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:35.677028 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-325324d8-51b6-4910-8bec-e10458322ed0 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:35.805526 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-325324d8-51b6-4910-8bec-e10458322ed0 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf869873369f496e9e25a6d6b2a7ba86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:23:35.813297 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-325324d8-51b6-4910-8bec-e10458322ed0 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /compute/v2.1/servers/76d36b1d-a395-46b5-b80d-9fa1871c0873" status: 200 len: 1265 microversion: 2.1 time: 0.149386 Dec 14 03:23:35.813855 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 531/1086] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:23:35 2021] GET /compute/v2.1/servers/76d36b1d-a395-46b5-b80d-9fa1871c0873 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:23:36.006043 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-3dfe03c6-e0cc-43e2-872b-66cf21c34898 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:23:36.006960 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-3dfe03c6-e0cc-43e2-872b-66cf21c34898 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:36.013825 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3dfe03c6-e0cc-43e2-872b-66cf21c34898 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:36.014277 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3dfe03c6-e0cc-43e2-872b-66cf21c34898 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:36.015061 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3dfe03c6-e0cc-43e2-872b-66cf21c34898 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:36.015546 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3dfe03c6-e0cc-43e2-872b-66cf21c34898 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:36.118231 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-3dfe03c6-e0cc-43e2-872b-66cf21c34898 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action" status: 200 len: 28675 microversion: 2.1 time: 0.116728 Dec 14 03:23:36.119070 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 556/1087] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:23:35 2021] POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action => generated 28675 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:23:36.121046 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-07656436-ba17-46bc-bf4f-6cd35dcd09ec tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:23:36.121960 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-07656436-ba17-46bc-bf4f-6cd35dcd09ec tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:36.128154 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-07656436-ba17-46bc-bf4f-6cd35dcd09ec tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:36.128605 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-07656436-ba17-46bc-bf4f-6cd35dcd09ec tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:36.129381 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-07656436-ba17-46bc-bf4f-6cd35dcd09ec tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:36.129818 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-07656436-ba17-46bc-bf4f-6cd35dcd09ec tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:36.224918 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-07656436-ba17-46bc-bf4f-6cd35dcd09ec tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action" status: 200 len: 35202 microversion: 2.20 time: 0.107506 Dec 14 03:23:36.225572 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 532/1088] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:23:36 2021] POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action => generated 35202 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 14 03:23:36.830044 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-8017be17-251f-4128-a8a9-079832207aca tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:23:36.830786 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-8017be17-251f-4128-a8a9-079832207aca tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] [instance: 76d36b1d-a395-46b5-b80d-9fa1871c0873] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:36.837569 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8017be17-251f-4128-a8a9-079832207aca tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:36.838014 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8017be17-251f-4128-a8a9-079832207aca tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:36.838779 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8017be17-251f-4128-a8a9-079832207aca tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:36.839239 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8017be17-251f-4128-a8a9-079832207aca tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:36.973500 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-8017be17-251f-4128-a8a9-079832207aca tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf869873369f496e9e25a6d6b2a7ba86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:23:36.981445 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-8017be17-251f-4128-a8a9-079832207aca tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /compute/v2.1/servers/76d36b1d-a395-46b5-b80d-9fa1871c0873" status: 200 len: 1265 microversion: 2.1 time: 0.155354 Dec 14 03:23:36.991445 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 557/1089] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:23:36 2021] GET /compute/v2.1/servers/76d36b1d-a395-46b5-b80d-9fa1871c0873 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:23:37.129731 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-39be21e0-cf99-4364-a46a-5f4bdf01fb4e tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:23:37.130678 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-39be21e0-cf99-4364-a46a-5f4bdf01fb4e tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:37.137587 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-39be21e0-cf99-4364-a46a-5f4bdf01fb4e tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:37.138045 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-39be21e0-cf99-4364-a46a-5f4bdf01fb4e tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:37.138832 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-39be21e0-cf99-4364-a46a-5f4bdf01fb4e tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:37.139314 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-39be21e0-cf99-4364-a46a-5f4bdf01fb4e tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:37.236751 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-d6d24d01-2faa-40b3-85b2-2afab1fea5da tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:23:37.237914 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-d6d24d01-2faa-40b3-85b2-2afab1fea5da tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:37.244077 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d6d24d01-2faa-40b3-85b2-2afab1fea5da tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:37.244520 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d6d24d01-2faa-40b3-85b2-2afab1fea5da tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:37.245285 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d6d24d01-2faa-40b3-85b2-2afab1fea5da tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:37.245716 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d6d24d01-2faa-40b3-85b2-2afab1fea5da tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:37.315840 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-39be21e0-cf99-4364-a46a-5f4bdf01fb4e tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action" status: 200 len: 28675 microversion: 2.1 time: 0.189921 Dec 14 03:23:37.316729 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 533/1090] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:23:37 2021] POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action => generated 28675 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:23:37.346394 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-d6d24d01-2faa-40b3-85b2-2afab1fea5da tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action" status: 200 len: 36561 microversion: 2.20 time: 0.113110 Dec 14 03:23:37.347089 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 558/1091] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:23:37 2021] POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action => generated 36561 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 14 03:23:37.998654 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-8a7c016a-3a38-43f2-815b-0ac2ce9d3ae5 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:23:37.999391 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-8a7c016a-3a38-43f2-815b-0ac2ce9d3ae5 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] [instance: 76d36b1d-a395-46b5-b80d-9fa1871c0873] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:38.007073 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-8a7c016a-3a38-43f2-815b-0ac2ce9d3ae5 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:38.007671 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-8a7c016a-3a38-43f2-815b-0ac2ce9d3ae5 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:38.008457 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-8a7c016a-3a38-43f2-815b-0ac2ce9d3ae5 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:38.008899 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-8a7c016a-3a38-43f2-815b-0ac2ce9d3ae5 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:38.140716 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-8a7c016a-3a38-43f2-815b-0ac2ce9d3ae5 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf869873369f496e9e25a6d6b2a7ba86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:23:38.148541 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-8a7c016a-3a38-43f2-815b-0ac2ce9d3ae5 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /compute/v2.1/servers/76d36b1d-a395-46b5-b80d-9fa1871c0873" status: 200 len: 1265 microversion: 2.1 time: 0.153866 Dec 14 03:23:38.149098 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 534/1092] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:23:37 2021] GET /compute/v2.1/servers/76d36b1d-a395-46b5-b80d-9fa1871c0873 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:23:38.327943 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-2181cc5b-226d-417d-898e-182f944735f0 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:23:38.328950 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-2181cc5b-226d-417d-898e-182f944735f0 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:38.335866 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2181cc5b-226d-417d-898e-182f944735f0 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:38.336328 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2181cc5b-226d-417d-898e-182f944735f0 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:38.337111 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2181cc5b-226d-417d-898e-182f944735f0 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:38.337551 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2181cc5b-226d-417d-898e-182f944735f0 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:38.358528 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-75b804c2-4f79-4106-b486-be7a5dbe4e9e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:23:38.359466 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-75b804c2-4f79-4106-b486-be7a5dbe4e9e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:38.366523 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-75b804c2-4f79-4106-b486-be7a5dbe4e9e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:38.366975 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-75b804c2-4f79-4106-b486-be7a5dbe4e9e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:38.367788 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-75b804c2-4f79-4106-b486-be7a5dbe4e9e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:38.368220 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-75b804c2-4f79-4106-b486-be7a5dbe4e9e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:38.504502 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-2181cc5b-226d-417d-898e-182f944735f0 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action" status: 200 len: 28675 microversion: 2.1 time: 0.180365 Dec 14 03:23:38.505411 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 559/1093] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:23:38 2021] POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action => generated 28675 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:23:38.535473 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-75b804c2-4f79-4106-b486-be7a5dbe4e9e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action" status: 200 len: 38110 microversion: 2.20 time: 0.180386 Dec 14 03:23:38.536102 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 535/1094] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:23:38 2021] POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action => generated 38110 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 14 03:23:39.011980 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [req-e065a7bf-6df0-4dc5-9ac3-940a6fbaca95 req-4e3d2a2e-494c-4378-a641-658e6dba56fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76d36b1d-a395-46b5-b80d-9fa1871c0873", "name": "network-vif-plugged", "status": "completed", "tag": "ee1b94f1-9b24-4f43-ae74-a354e91e38f1"}]} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:23:39.013459 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:23:39.013459 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: warnings.warn(msg) Dec 14 03:23:39.021590 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-e065a7bf-6df0-4dc5-9ac3-940a6fbaca95 req-4e3d2a2e-494c-4378-a641-658e6dba56fa service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:39.022624 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-e065a7bf-6df0-4dc5-9ac3-940a6fbaca95 req-4e3d2a2e-494c-4378-a641-658e6dba56fa service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:39.034143 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.compute.server_external_events [req-e065a7bf-6df0-4dc5-9ac3-940a6fbaca95 req-4e3d2a2e-494c-4378-a641-658e6dba56fa service nova] Creating event network-vif-plugged:ee1b94f1-9b24-4f43-ae74-a354e91e38f1 for instance 76d36b1d-a395-46b5-b80d-9fa1871c0873 on hv-cinder-81803 Dec 14 03:23:39.038835 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [req-e065a7bf-6df0-4dc5-9ac3-940a6fbaca95 req-4e3d2a2e-494c-4378-a641-658e6dba56fa service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030820 Dec 14 03:23:39.039453 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 560/1095] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Dec 14 03:23:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:23:39.165388 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-c27da816-e323-47b4-85de-6ad7d5dc4ac1 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:23:39.165996 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-c27da816-e323-47b4-85de-6ad7d5dc4ac1 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] [instance: 76d36b1d-a395-46b5-b80d-9fa1871c0873] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:39.172760 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c27da816-e323-47b4-85de-6ad7d5dc4ac1 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:39.173210 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c27da816-e323-47b4-85de-6ad7d5dc4ac1 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:39.173991 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c27da816-e323-47b4-85de-6ad7d5dc4ac1 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:39.174430 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c27da816-e323-47b4-85de-6ad7d5dc4ac1 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:39.309379 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-c27da816-e323-47b4-85de-6ad7d5dc4ac1 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf869873369f496e9e25a6d6b2a7ba86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:23:39.316617 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-c27da816-e323-47b4-85de-6ad7d5dc4ac1 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /compute/v2.1/servers/76d36b1d-a395-46b5-b80d-9fa1871c0873" status: 200 len: 1265 microversion: 2.1 time: 0.155943 Dec 14 03:23:39.317194 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 536/1096] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:23:39 2021] GET /compute/v2.1/servers/76d36b1d-a395-46b5-b80d-9fa1871c0873 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:23:39.517250 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-cfa3342e-9182-4d47-a7a6-5467d1408777 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:23:39.518163 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-cfa3342e-9182-4d47-a7a6-5467d1408777 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:39.524252 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-cfa3342e-9182-4d47-a7a6-5467d1408777 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:39.524704 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-cfa3342e-9182-4d47-a7a6-5467d1408777 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:39.525481 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-cfa3342e-9182-4d47-a7a6-5467d1408777 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:39.526050 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-cfa3342e-9182-4d47-a7a6-5467d1408777 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:39.548043 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-0cd991ee-74d4-4789-a066-b2144b817eed tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:23:39.548955 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-0cd991ee-74d4-4789-a066-b2144b817eed tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:39.556485 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-0cd991ee-74d4-4789-a066-b2144b817eed tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:39.556943 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-0cd991ee-74d4-4789-a066-b2144b817eed tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:39.557730 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-0cd991ee-74d4-4789-a066-b2144b817eed tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:39.558171 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-0cd991ee-74d4-4789-a066-b2144b817eed tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:39.792940 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-0cd991ee-74d4-4789-a066-b2144b817eed tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action" status: 200 len: 38184 microversion: 2.20 time: 0.248399 Dec 14 03:23:39.793518 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 537/1097] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:23:39 2021] POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action => generated 38184 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 14 03:23:39.841483 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-cfa3342e-9182-4d47-a7a6-5467d1408777 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action" status: 200 len: 28675 microversion: 2.1 time: 0.328769 Dec 14 03:23:39.842153 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 561/1098] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:23:39 2021] POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action => generated 28675 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:23:40.333648 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-7a670071-8042-44a8-af69-109f5c25549c tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:23:40.334872 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-7a670071-8042-44a8-af69-109f5c25549c tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] [instance: 76d36b1d-a395-46b5-b80d-9fa1871c0873] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:40.341655 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-7a670071-8042-44a8-af69-109f5c25549c tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:40.342100 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-7a670071-8042-44a8-af69-109f5c25549c tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:40.342900 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-7a670071-8042-44a8-af69-109f5c25549c tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:40.343361 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-7a670071-8042-44a8-af69-109f5c25549c tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:40.474929 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-7a670071-8042-44a8-af69-109f5c25549c tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf869873369f496e9e25a6d6b2a7ba86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:23:40.482616 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-7a670071-8042-44a8-af69-109f5c25549c tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /compute/v2.1/servers/76d36b1d-a395-46b5-b80d-9fa1871c0873" status: 200 len: 1265 microversion: 2.1 time: 0.152961 Dec 14 03:23:40.483202 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 538/1099] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:23:40 2021] GET /compute/v2.1/servers/76d36b1d-a395-46b5-b80d-9fa1871c0873 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:23:40.805254 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-f9af45ed-b606-4d7a-a0ec-0dd7766bd327 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:23:40.806284 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-f9af45ed-b606-4d7a-a0ec-0dd7766bd327 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:40.813233 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f9af45ed-b606-4d7a-a0ec-0dd7766bd327 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:40.813683 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f9af45ed-b606-4d7a-a0ec-0dd7766bd327 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:40.814461 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f9af45ed-b606-4d7a-a0ec-0dd7766bd327 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:40.814885 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f9af45ed-b606-4d7a-a0ec-0dd7766bd327 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:40.853801 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-2819b768-61e2-4a57-b43c-1409730d7793 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:23:40.854818 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-2819b768-61e2-4a57-b43c-1409730d7793 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:40.862879 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-2819b768-61e2-4a57-b43c-1409730d7793 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:40.863489 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-2819b768-61e2-4a57-b43c-1409730d7793 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:40.864300 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-2819b768-61e2-4a57-b43c-1409730d7793 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:40.864738 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-2819b768-61e2-4a57-b43c-1409730d7793 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:40.949179 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-f9af45ed-b606-4d7a-a0ec-0dd7766bd327 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action" status: 200 len: 38184 microversion: 2.20 time: 0.148256 Dec 14 03:23:40.949822 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 562/1100] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:23:40 2021] POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action => generated 38184 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:23:41.002140 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-2819b768-61e2-4a57-b43c-1409730d7793 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action" status: 200 len: 28675 microversion: 2.1 time: 0.152466 Dec 14 03:23:41.002779 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 539/1101] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:23:40 2021] POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action => generated 28675 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:23:41.500461 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-e155da70-1c68-415d-bd75-dd6c712d4d8f tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:23:41.501163 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-e155da70-1c68-415d-bd75-dd6c712d4d8f tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] [instance: 76d36b1d-a395-46b5-b80d-9fa1871c0873] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:41.508025 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e155da70-1c68-415d-bd75-dd6c712d4d8f tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:41.508477 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e155da70-1c68-415d-bd75-dd6c712d4d8f tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:41.509252 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e155da70-1c68-415d-bd75-dd6c712d4d8f tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:41.509689 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e155da70-1c68-415d-bd75-dd6c712d4d8f tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:41.641997 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-e155da70-1c68-415d-bd75-dd6c712d4d8f tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf869873369f496e9e25a6d6b2a7ba86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:23:41.650287 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-e155da70-1c68-415d-bd75-dd6c712d4d8f tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /compute/v2.1/servers/76d36b1d-a395-46b5-b80d-9fa1871c0873" status: 200 len: 1452 microversion: 2.1 time: 0.153882 Dec 14 03:23:41.650852 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 563/1102] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:23:41 2021] GET /compute/v2.1/servers/76d36b1d-a395-46b5-b80d-9fa1871c0873 => generated 1452 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:23:41.666997 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-68b29607-3caf-4737-aac0-9f6a4079ade8 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:23:41.667720 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-68b29607-3caf-4737-aac0-9f6a4079ade8 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] [instance: 76d36b1d-a395-46b5-b80d-9fa1871c0873] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:41.674753 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-68b29607-3caf-4737-aac0-9f6a4079ade8 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:41.675231 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-68b29607-3caf-4737-aac0-9f6a4079ade8 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:41.676069 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-68b29607-3caf-4737-aac0-9f6a4079ade8 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:41.676625 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-68b29607-3caf-4737-aac0-9f6a4079ade8 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:41.810752 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-68b29607-3caf-4737-aac0-9f6a4079ade8 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf869873369f496e9e25a6d6b2a7ba86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:23:41.818153 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-68b29607-3caf-4737-aac0-9f6a4079ade8 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /compute/v2.1/servers/76d36b1d-a395-46b5-b80d-9fa1871c0873" status: 200 len: 1452 microversion: 2.1 time: 0.155701 Dec 14 03:23:41.818705 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 540/1103] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:23:41 2021] GET /compute/v2.1/servers/76d36b1d-a395-46b5-b80d-9fa1871c0873 => generated 1452 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:23:41.960869 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-bcc36958-0104-460f-b002-6df281f2f77c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:23:41.961791 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-bcc36958-0104-460f-b002-6df281f2f77c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:41.968065 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-bcc36958-0104-460f-b002-6df281f2f77c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:41.968521 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-bcc36958-0104-460f-b002-6df281f2f77c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:41.969309 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-bcc36958-0104-460f-b002-6df281f2f77c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:41.969743 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-bcc36958-0104-460f-b002-6df281f2f77c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:42.013709 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-aeadad09-535c-4cc6-a224-cbe7045af034 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:23:42.014654 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-aeadad09-535c-4cc6-a224-cbe7045af034 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:42.023616 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-aeadad09-535c-4cc6-a224-cbe7045af034 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:42.024067 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-aeadad09-535c-4cc6-a224-cbe7045af034 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:42.024847 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-aeadad09-535c-4cc6-a224-cbe7045af034 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:42.025284 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-aeadad09-535c-4cc6-a224-cbe7045af034 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:42.060265 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-bcc36958-0104-460f-b002-6df281f2f77c tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action" status: 200 len: 38184 microversion: 2.20 time: 0.103451 Dec 14 03:23:42.061744 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 564/1104] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:23:41 2021] POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action => generated 38184 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:23:42.114801 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-aeadad09-535c-4cc6-a224-cbe7045af034 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action" status: 200 len: 28675 microversion: 2.1 time: 0.104611 Dec 14 03:23:42.115482 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 541/1105] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:23:42 2021] POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action => generated 28675 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:23:43.072858 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-faad91cf-68d0-4983-8891-5718363852c3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:23:43.073895 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-faad91cf-68d0-4983-8891-5718363852c3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:43.080741 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-faad91cf-68d0-4983-8891-5718363852c3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:43.081192 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-faad91cf-68d0-4983-8891-5718363852c3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:43.081970 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-faad91cf-68d0-4983-8891-5718363852c3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:43.082410 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-faad91cf-68d0-4983-8891-5718363852c3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:43.126186 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-6d6f7887-c16a-4e64-bcc2-cf598e2b2c55 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:23:43.127383 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-6d6f7887-c16a-4e64-bcc2-cf598e2b2c55 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:43.134431 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-6d6f7887-c16a-4e64-bcc2-cf598e2b2c55 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:43.134965 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-6d6f7887-c16a-4e64-bcc2-cf598e2b2c55 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:43.135849 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-6d6f7887-c16a-4e64-bcc2-cf598e2b2c55 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:43.136363 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-6d6f7887-c16a-4e64-bcc2-cf598e2b2c55 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:43.176477 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-faad91cf-68d0-4983-8891-5718363852c3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action" status: 200 len: 38325 microversion: 2.20 time: 0.107443 Dec 14 03:23:43.177072 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 565/1106] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:23:43 2021] POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action => generated 38325 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:23:43.187127 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-42f03681-0fc4-4268-8be4-4d1034ba599e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:23:43.187801 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-42f03681-0fc4-4268-8be4-4d1034ba599e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:43.194613 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-42f03681-0fc4-4268-8be4-4d1034ba599e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:43.195161 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-42f03681-0fc4-4268-8be4-4d1034ba599e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:43.196005 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-42f03681-0fc4-4268-8be4-4d1034ba599e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:43.196508 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-42f03681-0fc4-4268-8be4-4d1034ba599e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:43.219910 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-42f03681-0fc4-4268-8be4-4d1034ba599e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/ips" status: 200 len: 153 microversion: 2.20 time: 0.036591 Dec 14 03:23:43.220477 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 566/1107] 10.222.0.43 () {60 vars in 1288 bytes} [Tue Dec 14 03:23:43 2021] GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/ips => generated 153 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 14 03:23:43.237607 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-6d6f7887-c16a-4e64-bcc2-cf598e2b2c55 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action" status: 200 len: 28675 microversion: 2.1 time: 0.115025 Dec 14 03:23:43.238845 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 542/1108] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:23:43 2021] POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action => generated 28675 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 14 03:23:43.471946 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [req-1c929305-3467-4e48-ac94-750c9d2da4b7 req-dbd7a6ed-02d3-49ab-bce3-f86ef70ad34f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76d36b1d-a395-46b5-b80d-9fa1871c0873", "tag": "ee1b94f1-9b24-4f43-ae74-a354e91e38f1"}]} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:23:43.473694 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:23:43.473694 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: warnings.warn(msg) Dec 14 03:23:43.481624 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-1c929305-3467-4e48-ac94-750c9d2da4b7 req-dbd7a6ed-02d3-49ab-bce3-f86ef70ad34f service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:43.482506 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-1c929305-3467-4e48-ac94-750c9d2da4b7 req-dbd7a6ed-02d3-49ab-bce3-f86ef70ad34f service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:43.505946 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.compute.server_external_events [req-1c929305-3467-4e48-ac94-750c9d2da4b7 req-dbd7a6ed-02d3-49ab-bce3-f86ef70ad34f service nova] Creating event network-changed:ee1b94f1-9b24-4f43-ae74-a354e91e38f1 for instance 76d36b1d-a395-46b5-b80d-9fa1871c0873 on hv-cinder-81803 Dec 14 03:23:43.511671 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [req-1c929305-3467-4e48-ac94-750c9d2da4b7 req-dbd7a6ed-02d3-49ab-bce3-f86ef70ad34f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043554 Dec 14 03:23:43.512581 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 567/1109] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Dec 14 03:23:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:23:44.250211 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-2a57609f-f054-4024-bd06-1408993c8253 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:23:44.251439 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-2a57609f-f054-4024-bd06-1408993c8253 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:44.258378 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-2a57609f-f054-4024-bd06-1408993c8253 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:44.258823 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-2a57609f-f054-4024-bd06-1408993c8253 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:44.259706 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-2a57609f-f054-4024-bd06-1408993c8253 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:44.260140 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-2a57609f-f054-4024-bd06-1408993c8253 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:44.342353 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-2a57609f-f054-4024-bd06-1408993c8253 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action" status: 200 len: 28675 microversion: 2.1 time: 0.095954 Dec 14 03:23:44.343094 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 543/1110] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:23:44 2021] POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action => generated 28675 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 14 03:23:45.354987 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-3919ef48-6071-4981-8fa9-3c2bffcbeabd tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:23:45.355998 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-3919ef48-6071-4981-8fa9-3c2bffcbeabd tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:45.362235 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3919ef48-6071-4981-8fa9-3c2bffcbeabd tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:45.362954 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3919ef48-6071-4981-8fa9-3c2bffcbeabd tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:45.363766 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3919ef48-6071-4981-8fa9-3c2bffcbeabd tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:45.364202 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3919ef48-6071-4981-8fa9-3c2bffcbeabd tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:45.407247 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-6183f656-b34e-476f-b4f2-ff15146039aa tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:23:45.407881 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-6183f656-b34e-476f-b4f2-ff15146039aa tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:45.414837 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-6183f656-b34e-476f-b4f2-ff15146039aa tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:45.415325 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-6183f656-b34e-476f-b4f2-ff15146039aa tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:45.416147 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-6183f656-b34e-476f-b4f2-ff15146039aa tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:45.416596 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-6183f656-b34e-476f-b4f2-ff15146039aa tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:45.441497 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.objects.instance [None req-6183f656-b34e-476f-b4f2-ff15146039aa tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lazy-loading 'flavor' on Instance uuid 279d5888-562c-4c6a-b27c-3f8e84fd510f {{(pid=116071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 14 03:23:45.455989 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-3919ef48-6071-4981-8fa9-3c2bffcbeabd tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action" status: 200 len: 28675 microversion: 2.1 time: 0.105272 Dec 14 03:23:45.459985 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 568/1111] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:23:45 2021] POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action => generated 28675 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 14 03:23:45.691033 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-6183f656-b34e-476f-b4f2-ff15146039aa tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action" status: 202 len: 0 microversion: 2.20 time: 0.287814 Dec 14 03:23:45.691684 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 544/1112] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:23:45 2021] POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Dec 14 03:23:45.699956 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-29422ea4-d2dd-4bf5-9083-5a4768bda3a0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:23:45.700664 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-29422ea4-d2dd-4bf5-9083-5a4768bda3a0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:45.707472 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-29422ea4-d2dd-4bf5-9083-5a4768bda3a0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:45.707923 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-29422ea4-d2dd-4bf5-9083-5a4768bda3a0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:45.708715 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-29422ea4-d2dd-4bf5-9083-5a4768bda3a0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:45.709157 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-29422ea4-d2dd-4bf5-9083-5a4768bda3a0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:45.837345 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-29422ea4-d2dd-4bf5-9083-5a4768bda3a0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:23:45.845519 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-29422ea4-d2dd-4bf5-9083-5a4768bda3a0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:23:45.847018 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-29422ea4-d2dd-4bf5-9083-5a4768bda3a0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:23:45.848229 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-29422ea4-d2dd-4bf5-9083-5a4768bda3a0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f" status: 200 len: 1723 microversion: 2.20 time: 0.152276 Dec 14 03:23:45.848790 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 569/1113] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:23:45 2021] GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:23:46.468394 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-6331f788-5ee9-4b07-932a-0621bdd11933 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:23:46.469578 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-6331f788-5ee9-4b07-932a-0621bdd11933 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:46.476289 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-6331f788-5ee9-4b07-932a-0621bdd11933 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:46.476985 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-6331f788-5ee9-4b07-932a-0621bdd11933 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:46.477790 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-6331f788-5ee9-4b07-932a-0621bdd11933 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:46.478232 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-6331f788-5ee9-4b07-932a-0621bdd11933 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:46.561779 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-6331f788-5ee9-4b07-932a-0621bdd11933 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action" status: 200 len: 28675 microversion: 2.1 time: 0.097687 Dec 14 03:23:46.562653 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 545/1114] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:23:46 2021] POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action => generated 28675 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:23:46.867652 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-e5482051-7eb5-4500-9730-4e5ea8801be2 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:23:46.868266 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-e5482051-7eb5-4500-9730-4e5ea8801be2 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:46.874444 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e5482051-7eb5-4500-9730-4e5ea8801be2 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:46.874895 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e5482051-7eb5-4500-9730-4e5ea8801be2 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:46.875728 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e5482051-7eb5-4500-9730-4e5ea8801be2 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:46.876144 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e5482051-7eb5-4500-9730-4e5ea8801be2 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:47.006291 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-e5482051-7eb5-4500-9730-4e5ea8801be2 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:23:47.013841 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-e5482051-7eb5-4500-9730-4e5ea8801be2 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:23:47.015345 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-e5482051-7eb5-4500-9730-4e5ea8801be2 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:23:47.016499 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-e5482051-7eb5-4500-9730-4e5ea8801be2 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f" status: 200 len: 1723 microversion: 2.20 time: 0.152602 Dec 14 03:23:47.017060 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 570/1115] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:23:46 2021] GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:23:47.573453 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-a147ab75-9d06-44c5-863a-ea2df5c53bfd tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:23:47.574516 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-a147ab75-9d06-44c5-863a-ea2df5c53bfd tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:47.581488 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a147ab75-9d06-44c5-863a-ea2df5c53bfd tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:47.581951 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a147ab75-9d06-44c5-863a-ea2df5c53bfd tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:47.583341 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a147ab75-9d06-44c5-863a-ea2df5c53bfd tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:47.583844 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a147ab75-9d06-44c5-863a-ea2df5c53bfd tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:47.679068 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-a147ab75-9d06-44c5-863a-ea2df5c53bfd tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action" status: 200 len: 28675 microversion: 2.1 time: 0.109367 Dec 14 03:23:47.690919 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 546/1116] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:23:47 2021] POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action => generated 28675 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:23:48.034295 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-5ee9fe64-6075-419b-ad90-6d3427b6269a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:23:48.034887 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-5ee9fe64-6075-419b-ad90-6d3427b6269a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:48.041591 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5ee9fe64-6075-419b-ad90-6d3427b6269a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:48.042034 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5ee9fe64-6075-419b-ad90-6d3427b6269a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:48.042800 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5ee9fe64-6075-419b-ad90-6d3427b6269a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:48.043263 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5ee9fe64-6075-419b-ad90-6d3427b6269a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:48.173502 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-5ee9fe64-6075-419b-ad90-6d3427b6269a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:23:48.181903 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-5ee9fe64-6075-419b-ad90-6d3427b6269a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:23:48.183440 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-5ee9fe64-6075-419b-ad90-6d3427b6269a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:23:48.184592 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-5ee9fe64-6075-419b-ad90-6d3427b6269a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f" status: 200 len: 1723 microversion: 2.20 time: 0.154020 Dec 14 03:23:48.185142 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 571/1117] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:23:48 2021] GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:23:48.692082 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-3bc48966-696d-41e9-bff7-4abee392c211 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:23:48.693095 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-3bc48966-696d-41e9-bff7-4abee392c211 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:48.700144 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-3bc48966-696d-41e9-bff7-4abee392c211 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:48.700597 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-3bc48966-696d-41e9-bff7-4abee392c211 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:48.701383 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-3bc48966-696d-41e9-bff7-4abee392c211 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:48.701829 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-3bc48966-696d-41e9-bff7-4abee392c211 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:48.792649 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-3bc48966-696d-41e9-bff7-4abee392c211 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action" status: 200 len: 28675 microversion: 2.1 time: 0.104475 Dec 14 03:23:48.793272 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 547/1118] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:23:48 2021] POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action => generated 28675 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:23:49.203155 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-dc121754-2807-4653-a0e6-22d0cc9b0a4e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:23:49.203767 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-dc121754-2807-4653-a0e6-22d0cc9b0a4e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:49.210445 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-dc121754-2807-4653-a0e6-22d0cc9b0a4e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:49.210891 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-dc121754-2807-4653-a0e6-22d0cc9b0a4e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:49.211690 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-dc121754-2807-4653-a0e6-22d0cc9b0a4e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:49.212125 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-dc121754-2807-4653-a0e6-22d0cc9b0a4e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:49.335507 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-dc121754-2807-4653-a0e6-22d0cc9b0a4e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:23:49.343012 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-dc121754-2807-4653-a0e6-22d0cc9b0a4e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:23:49.344508 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-dc121754-2807-4653-a0e6-22d0cc9b0a4e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:23:49.345655 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-dc121754-2807-4653-a0e6-22d0cc9b0a4e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f" status: 200 len: 1723 microversion: 2.20 time: 0.146327 Dec 14 03:23:49.346206 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 572/1119] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:23:49 2021] GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f => generated 1723 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:23:49.805267 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-5505efb9-8946-4307-a71e-12f1544a1255 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:23:49.806229 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-5505efb9-8946-4307-a71e-12f1544a1255 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:49.813118 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-5505efb9-8946-4307-a71e-12f1544a1255 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:49.813572 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-5505efb9-8946-4307-a71e-12f1544a1255 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:49.814351 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-5505efb9-8946-4307-a71e-12f1544a1255 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:49.814791 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-5505efb9-8946-4307-a71e-12f1544a1255 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:49.906268 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-5505efb9-8946-4307-a71e-12f1544a1255 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action" status: 200 len: 28675 microversion: 2.1 time: 0.105526 Dec 14 03:23:49.906950 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 548/1120] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:23:49 2021] POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action => generated 28675 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:23:50.364635 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-a1ac3f23-8543-4d31-be0b-d11f98d9ba5f tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:23:50.365248 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-a1ac3f23-8543-4d31-be0b-d11f98d9ba5f tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:50.372242 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a1ac3f23-8543-4d31-be0b-d11f98d9ba5f tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:50.372685 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a1ac3f23-8543-4d31-be0b-d11f98d9ba5f tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:50.373452 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a1ac3f23-8543-4d31-be0b-d11f98d9ba5f tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:50.373885 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a1ac3f23-8543-4d31-be0b-d11f98d9ba5f tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:50.502975 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-a1ac3f23-8543-4d31-be0b-d11f98d9ba5f tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:23:50.510573 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-a1ac3f23-8543-4d31-be0b-d11f98d9ba5f tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:23:50.512083 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-a1ac3f23-8543-4d31-be0b-d11f98d9ba5f tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:23:50.513226 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-a1ac3f23-8543-4d31-be0b-d11f98d9ba5f tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f" status: 200 len: 1723 microversion: 2.20 time: 0.152628 Dec 14 03:23:50.513775 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 573/1121] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:23:50 2021] GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:23:50.918257 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-ef25c5b3-b476-4086-887f-e6a7605bb634 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:23:50.919232 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-ef25c5b3-b476-4086-887f-e6a7605bb634 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:50.926119 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ef25c5b3-b476-4086-887f-e6a7605bb634 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:50.926579 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ef25c5b3-b476-4086-887f-e6a7605bb634 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:50.927404 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ef25c5b3-b476-4086-887f-e6a7605bb634 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:50.927850 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ef25c5b3-b476-4086-887f-e6a7605bb634 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:51.018671 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-ef25c5b3-b476-4086-887f-e6a7605bb634 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action" status: 200 len: 28675 microversion: 2.1 time: 0.104434 Dec 14 03:23:51.019324 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 549/1122] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:23:50 2021] POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action => generated 28675 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:23:51.531258 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-9c4ae11a-6f84-4bff-9d17-a7c30e1ab601 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:23:51.531865 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-9c4ae11a-6f84-4bff-9d17-a7c30e1ab601 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:51.538166 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9c4ae11a-6f84-4bff-9d17-a7c30e1ab601 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:51.538612 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9c4ae11a-6f84-4bff-9d17-a7c30e1ab601 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:51.539403 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9c4ae11a-6f84-4bff-9d17-a7c30e1ab601 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:51.539841 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9c4ae11a-6f84-4bff-9d17-a7c30e1ab601 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:51.680741 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-9c4ae11a-6f84-4bff-9d17-a7c30e1ab601 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:23:51.688278 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-9c4ae11a-6f84-4bff-9d17-a7c30e1ab601 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:23:51.689755 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-9c4ae11a-6f84-4bff-9d17-a7c30e1ab601 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:23:51.690898 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-9c4ae11a-6f84-4bff-9d17-a7c30e1ab601 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f" status: 200 len: 1723 microversion: 2.20 time: 0.163343 Dec 14 03:23:51.691489 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 574/1123] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:23:51 2021] GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:23:52.031626 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-af4f86eb-7ae9-41b3-a5f0-fa62dc0c87ff tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:23:52.032575 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-af4f86eb-7ae9-41b3-a5f0-fa62dc0c87ff tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:52.040060 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-af4f86eb-7ae9-41b3-a5f0-fa62dc0c87ff tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:52.040518 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-af4f86eb-7ae9-41b3-a5f0-fa62dc0c87ff tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:52.041311 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-af4f86eb-7ae9-41b3-a5f0-fa62dc0c87ff tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:52.041759 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-af4f86eb-7ae9-41b3-a5f0-fa62dc0c87ff tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:52.132213 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-af4f86eb-7ae9-41b3-a5f0-fa62dc0c87ff tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action" status: 200 len: 28675 microversion: 2.1 time: 0.104612 Dec 14 03:23:52.133008 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 550/1124] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:23:52 2021] POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action => generated 28675 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:23:52.708948 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-a719fc89-d20b-43e4-9e05-ac4b521a65e0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:23:52.710202 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-a719fc89-d20b-43e4-9e05-ac4b521a65e0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:52.716757 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a719fc89-d20b-43e4-9e05-ac4b521a65e0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:52.717214 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a719fc89-d20b-43e4-9e05-ac4b521a65e0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:52.718163 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a719fc89-d20b-43e4-9e05-ac4b521a65e0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:52.718599 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a719fc89-d20b-43e4-9e05-ac4b521a65e0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:52.843920 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-a719fc89-d20b-43e4-9e05-ac4b521a65e0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:23:52.851699 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-a719fc89-d20b-43e4-9e05-ac4b521a65e0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:23:52.853183 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-a719fc89-d20b-43e4-9e05-ac4b521a65e0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:23:52.854328 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-a719fc89-d20b-43e4-9e05-ac4b521a65e0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f" status: 200 len: 1723 microversion: 2.20 time: 0.149219 Dec 14 03:23:52.854883 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 575/1125] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:23:52 2021] GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:23:53.144453 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-9ae6e2c9-1982-4008-8a5c-3cc565ebc53a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:23:53.145480 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-9ae6e2c9-1982-4008-8a5c-3cc565ebc53a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:53.152354 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-9ae6e2c9-1982-4008-8a5c-3cc565ebc53a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:53.152812 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-9ae6e2c9-1982-4008-8a5c-3cc565ebc53a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:53.153596 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-9ae6e2c9-1982-4008-8a5c-3cc565ebc53a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:53.154039 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-9ae6e2c9-1982-4008-8a5c-3cc565ebc53a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:53.243640 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-9ae6e2c9-1982-4008-8a5c-3cc565ebc53a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action" status: 200 len: 28675 microversion: 2.1 time: 0.103137 Dec 14 03:23:53.244262 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 551/1126] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:23:53 2021] POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action => generated 28675 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:23:53.872630 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-b7b077de-cfa8-43db-95de-c9e4b8e7aa86 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:23:53.873238 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-b7b077de-cfa8-43db-95de-c9e4b8e7aa86 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:53.879456 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b7b077de-cfa8-43db-95de-c9e4b8e7aa86 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:53.879949 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b7b077de-cfa8-43db-95de-c9e4b8e7aa86 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:53.880716 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b7b077de-cfa8-43db-95de-c9e4b8e7aa86 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:53.881656 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b7b077de-cfa8-43db-95de-c9e4b8e7aa86 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:54.011264 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-b7b077de-cfa8-43db-95de-c9e4b8e7aa86 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:23:54.018856 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-b7b077de-cfa8-43db-95de-c9e4b8e7aa86 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:23:54.020361 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-b7b077de-cfa8-43db-95de-c9e4b8e7aa86 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:23:54.021505 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-b7b077de-cfa8-43db-95de-c9e4b8e7aa86 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f" status: 200 len: 1723 microversion: 2.20 time: 0.152555 Dec 14 03:23:54.022621 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 576/1127] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:23:53 2021] GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:23:54.256592 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-3c1f07c2-e973-4c60-a049-c46a5f82971a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:23:54.257529 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-3c1f07c2-e973-4c60-a049-c46a5f82971a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:54.264380 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-3c1f07c2-e973-4c60-a049-c46a5f82971a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:54.264842 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-3c1f07c2-e973-4c60-a049-c46a5f82971a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:54.265659 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-3c1f07c2-e973-4c60-a049-c46a5f82971a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:54.266104 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-3c1f07c2-e973-4c60-a049-c46a5f82971a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:54.350766 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-3c1f07c2-e973-4c60-a049-c46a5f82971a tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action" status: 200 len: 28675 microversion: 2.1 time: 0.098807 Dec 14 03:23:54.351453 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 552/1128] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:23:54 2021] POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action => generated 28675 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:23:55.041077 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-f3b30b8e-ab75-40a3-9b3a-a0d00ba54db3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:23:55.041622 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-f3b30b8e-ab75-40a3-9b3a-a0d00ba54db3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:55.047982 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f3b30b8e-ab75-40a3-9b3a-a0d00ba54db3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:55.048436 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f3b30b8e-ab75-40a3-9b3a-a0d00ba54db3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:55.049214 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f3b30b8e-ab75-40a3-9b3a-a0d00ba54db3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:55.049653 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f3b30b8e-ab75-40a3-9b3a-a0d00ba54db3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:55.174402 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-f3b30b8e-ab75-40a3-9b3a-a0d00ba54db3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:23:55.182534 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-f3b30b8e-ab75-40a3-9b3a-a0d00ba54db3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:23:55.184052 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-f3b30b8e-ab75-40a3-9b3a-a0d00ba54db3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:23:55.185209 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-f3b30b8e-ab75-40a3-9b3a-a0d00ba54db3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f" status: 200 len: 1723 microversion: 2.20 time: 0.148587 Dec 14 03:23:55.185770 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 577/1129] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:23:55 2021] GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:23:55.362128 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-14fab3c8-9059-4ef4-9914-e93287658867 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:23:55.363419 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-14fab3c8-9059-4ef4-9914-e93287658867 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:55.370689 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-14fab3c8-9059-4ef4-9914-e93287658867 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:55.371173 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-14fab3c8-9059-4ef4-9914-e93287658867 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:55.371946 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-14fab3c8-9059-4ef4-9914-e93287658867 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:55.372381 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-14fab3c8-9059-4ef4-9914-e93287658867 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:55.461300 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-14fab3c8-9059-4ef4-9914-e93287658867 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action" status: 200 len: 28675 microversion: 2.1 time: 0.103035 Dec 14 03:23:55.462230 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 553/1130] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:23:55 2021] POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action => generated 28675 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:23:56.203837 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-040cc988-8fd3-4692-bb5f-d6a1dbee18b0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:23:56.204494 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-040cc988-8fd3-4692-bb5f-d6a1dbee18b0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:56.210797 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-040cc988-8fd3-4692-bb5f-d6a1dbee18b0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:56.211290 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-040cc988-8fd3-4692-bb5f-d6a1dbee18b0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:56.212073 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-040cc988-8fd3-4692-bb5f-d6a1dbee18b0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:56.212515 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-040cc988-8fd3-4692-bb5f-d6a1dbee18b0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:56.341669 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-040cc988-8fd3-4692-bb5f-d6a1dbee18b0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:23:56.349388 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-040cc988-8fd3-4692-bb5f-d6a1dbee18b0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:23:56.351416 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-040cc988-8fd3-4692-bb5f-d6a1dbee18b0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:23:56.352600 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-040cc988-8fd3-4692-bb5f-d6a1dbee18b0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f" status: 200 len: 1723 microversion: 2.20 time: 0.152443 Dec 14 03:23:56.353163 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 578/1131] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:23:56 2021] GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:23:56.475421 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-bd652cd3-50d1-48a7-a07c-fd2b94bda382 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:23:56.476379 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-bd652cd3-50d1-48a7-a07c-fd2b94bda382 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:56.483288 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-bd652cd3-50d1-48a7-a07c-fd2b94bda382 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:56.483745 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-bd652cd3-50d1-48a7-a07c-fd2b94bda382 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:56.484527 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-bd652cd3-50d1-48a7-a07c-fd2b94bda382 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:56.484989 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-bd652cd3-50d1-48a7-a07c-fd2b94bda382 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:56.960422 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-bd652cd3-50d1-48a7-a07c-fd2b94bda382 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action" status: 200 len: 28675 microversion: 2.1 time: 0.490850 Dec 14 03:23:56.961111 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 554/1132] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:23:56 2021] POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action => generated 28675 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:23:57.371565 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-d9c9f063-f2d3-48c8-abf6-4c03b0a70019 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:23:57.372181 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-d9c9f063-f2d3-48c8-abf6-4c03b0a70019 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:57.378439 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d9c9f063-f2d3-48c8-abf6-4c03b0a70019 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:57.378892 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d9c9f063-f2d3-48c8-abf6-4c03b0a70019 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:57.379697 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d9c9f063-f2d3-48c8-abf6-4c03b0a70019 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:57.380139 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d9c9f063-f2d3-48c8-abf6-4c03b0a70019 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:57.506504 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-d9c9f063-f2d3-48c8-abf6-4c03b0a70019 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:23:57.514329 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-d9c9f063-f2d3-48c8-abf6-4c03b0a70019 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:23:57.515908 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-d9c9f063-f2d3-48c8-abf6-4c03b0a70019 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:23:57.517100 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-d9c9f063-f2d3-48c8-abf6-4c03b0a70019 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f" status: 200 len: 1744 microversion: 2.20 time: 0.149162 Dec 14 03:23:57.517662 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 579/1133] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:23:57 2021] GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f => generated 1744 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:23:57.972687 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-453a23fa-2c7d-4957-b025-13b76f936848 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:23:57.973604 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-453a23fa-2c7d-4957-b025-13b76f936848 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:57.980417 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-453a23fa-2c7d-4957-b025-13b76f936848 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:57.980869 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-453a23fa-2c7d-4957-b025-13b76f936848 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:57.981646 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-453a23fa-2c7d-4957-b025-13b76f936848 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:57.982080 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-453a23fa-2c7d-4957-b025-13b76f936848 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:58.073006 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-453a23fa-2c7d-4957-b025-13b76f936848 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action" status: 200 len: 28675 microversion: 2.1 time: 0.104361 Dec 14 03:23:58.073634 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 555/1134] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:23:57 2021] POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action => generated 28675 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:23:58.535744 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-aec96fc5-5cc6-4ffb-9554-32dd1ebe4f9d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:23:58.536360 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-aec96fc5-5cc6-4ffb-9554-32dd1ebe4f9d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:58.543163 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-aec96fc5-5cc6-4ffb-9554-32dd1ebe4f9d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:58.543620 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-aec96fc5-5cc6-4ffb-9554-32dd1ebe4f9d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:58.544399 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-aec96fc5-5cc6-4ffb-9554-32dd1ebe4f9d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:58.544844 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-aec96fc5-5cc6-4ffb-9554-32dd1ebe4f9d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:58.682586 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-aec96fc5-5cc6-4ffb-9554-32dd1ebe4f9d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:23:58.690289 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-aec96fc5-5cc6-4ffb-9554-32dd1ebe4f9d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:23:58.691820 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-aec96fc5-5cc6-4ffb-9554-32dd1ebe4f9d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:23:58.692976 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-aec96fc5-5cc6-4ffb-9554-32dd1ebe4f9d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f" status: 200 len: 1744 microversion: 2.20 time: 0.160961 Dec 14 03:23:58.693580 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 580/1135] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:23:58 2021] GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f => generated 1744 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:23:59.085730 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-d6d566bd-8f63-4ab9-960f-17e74bf11055 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:23:59.086734 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-d6d566bd-8f63-4ab9-960f-17e74bf11055 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:59.093459 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-d6d566bd-8f63-4ab9-960f-17e74bf11055 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:59.093912 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-d6d566bd-8f63-4ab9-960f-17e74bf11055 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:59.094692 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-d6d566bd-8f63-4ab9-960f-17e74bf11055 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:59.095156 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-d6d566bd-8f63-4ab9-960f-17e74bf11055 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:59.198742 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-d6d566bd-8f63-4ab9-960f-17e74bf11055 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action" status: 200 len: 28675 microversion: 2.1 time: 0.117304 Dec 14 03:23:59.202820 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 556/1136] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:23:59 2021] POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action => generated 28675 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:23:59.711607 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-12d0ef3f-0eae-4ac9-994f-21faf6696f15 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:23:59.712219 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-12d0ef3f-0eae-4ac9-994f-21faf6696f15 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:23:59.718469 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-12d0ef3f-0eae-4ac9-994f-21faf6696f15 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:59.718921 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-12d0ef3f-0eae-4ac9-994f-21faf6696f15 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:59.719729 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-12d0ef3f-0eae-4ac9-994f-21faf6696f15 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:23:59.720167 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-12d0ef3f-0eae-4ac9-994f-21faf6696f15 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:23:59.845149 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-12d0ef3f-0eae-4ac9-994f-21faf6696f15 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:23:59.853400 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-12d0ef3f-0eae-4ac9-994f-21faf6696f15 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:23:59.854899 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-12d0ef3f-0eae-4ac9-994f-21faf6696f15 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:23:59.856085 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-12d0ef3f-0eae-4ac9-994f-21faf6696f15 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f" status: 200 len: 1744 microversion: 2.20 time: 0.148757 Dec 14 03:23:59.856638 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 581/1137] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:23:59 2021] GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f => generated 1744 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:24:00.211699 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-196060d8-7d09-455b-bb9b-21c35bcc8334 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:24:00.212712 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-196060d8-7d09-455b-bb9b-21c35bcc8334 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:24:00.219584 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-196060d8-7d09-455b-bb9b-21c35bcc8334 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:00.220040 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-196060d8-7d09-455b-bb9b-21c35bcc8334 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:00.220822 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-196060d8-7d09-455b-bb9b-21c35bcc8334 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:00.221264 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-196060d8-7d09-455b-bb9b-21c35bcc8334 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:00.312663 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-196060d8-7d09-455b-bb9b-21c35bcc8334 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action" status: 200 len: 28675 microversion: 2.1 time: 0.105532 Dec 14 03:24:00.313533 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 557/1138] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:24:00 2021] POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action => generated 28675 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:24:00.873736 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-003da9ab-5277-456e-a20c-e1fa621dccfb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:24:00.874274 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-003da9ab-5277-456e-a20c-e1fa621dccfb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:24:00.880520 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-003da9ab-5277-456e-a20c-e1fa621dccfb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:00.881000 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-003da9ab-5277-456e-a20c-e1fa621dccfb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:00.881812 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-003da9ab-5277-456e-a20c-e1fa621dccfb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:00.882241 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-003da9ab-5277-456e-a20c-e1fa621dccfb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:01.005527 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-003da9ab-5277-456e-a20c-e1fa621dccfb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:01.013058 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-003da9ab-5277-456e-a20c-e1fa621dccfb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:01.014530 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-003da9ab-5277-456e-a20c-e1fa621dccfb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:01.015707 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-003da9ab-5277-456e-a20c-e1fa621dccfb tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f" status: 200 len: 1744 microversion: 2.20 time: 0.145721 Dec 14 03:24:01.016264 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 582/1139] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:24:00 2021] GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f => generated 1744 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:24:01.183154 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [req-26c2b607-439b-4b72-966a-9b7ebbb078f9 req-321496fd-6ffb-41af-843d-e63592e855c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "279d5888-562c-4c6a-b27c-3f8e84fd510f", "name": "network-vif-plugged", "status": "completed", "tag": "9eee83b0-b14c-403e-a6bd-7d2515f7e214"}]} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:24:01.184672 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:24:01.184672 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: warnings.warn(msg) Dec 14 03:24:01.193123 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [req-26c2b607-439b-4b72-966a-9b7ebbb078f9 req-321496fd-6ffb-41af-843d-e63592e855c6 service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:01.193578 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [req-26c2b607-439b-4b72-966a-9b7ebbb078f9 req-321496fd-6ffb-41af-843d-e63592e855c6 service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:01.204490 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.compute.server_external_events [req-26c2b607-439b-4b72-966a-9b7ebbb078f9 req-321496fd-6ffb-41af-843d-e63592e855c6 service nova] Creating event network-vif-plugged:9eee83b0-b14c-403e-a6bd-7d2515f7e214 for instance 279d5888-562c-4c6a-b27c-3f8e84fd510f on hv-cinder-81803 Dec 14 03:24:01.209885 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [req-26c2b607-439b-4b72-966a-9b7ebbb078f9 req-321496fd-6ffb-41af-843d-e63592e855c6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030731 Dec 14 03:24:01.210466 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 558/1140] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Dec 14 03:24:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:24:01.323522 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-a192c2a7-35d4-48b9-be45-818b0e4760ce tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:24:01.324439 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-a192c2a7-35d4-48b9-be45-818b0e4760ce tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:24:01.330301 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a192c2a7-35d4-48b9-be45-818b0e4760ce tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:01.330752 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a192c2a7-35d4-48b9-be45-818b0e4760ce tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:01.331560 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a192c2a7-35d4-48b9-be45-818b0e4760ce tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:01.331995 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a192c2a7-35d4-48b9-be45-818b0e4760ce tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:01.432684 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-a192c2a7-35d4-48b9-be45-818b0e4760ce tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action" status: 200 len: 28675 microversion: 2.1 time: 0.112571 Dec 14 03:24:01.433277 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 583/1141] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:24:01 2021] POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action => generated 28675 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:24:02.035668 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-c969405e-f6af-43fa-aaac-57e238efe23e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:24:02.036370 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-c969405e-f6af-43fa-aaac-57e238efe23e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:24:02.043018 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c969405e-f6af-43fa-aaac-57e238efe23e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:02.043497 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c969405e-f6af-43fa-aaac-57e238efe23e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:02.044310 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c969405e-f6af-43fa-aaac-57e238efe23e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:02.044751 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c969405e-f6af-43fa-aaac-57e238efe23e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:02.174670 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-c969405e-f6af-43fa-aaac-57e238efe23e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:02.183909 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-c969405e-f6af-43fa-aaac-57e238efe23e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:02.185390 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-c969405e-f6af-43fa-aaac-57e238efe23e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:02.186546 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-c969405e-f6af-43fa-aaac-57e238efe23e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f" status: 200 len: 1744 microversion: 2.20 time: 0.155498 Dec 14 03:24:02.187111 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 559/1142] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:24:02 2021] GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f => generated 1744 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:24:02.445191 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-e471db21-f59d-4f86-ac8c-2b85dcd1ffd0 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:24:02.446200 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-e471db21-f59d-4f86-ac8c-2b85dcd1ffd0 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:24:02.453040 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e471db21-f59d-4f86-ac8c-2b85dcd1ffd0 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:02.453495 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e471db21-f59d-4f86-ac8c-2b85dcd1ffd0 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:02.454277 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e471db21-f59d-4f86-ac8c-2b85dcd1ffd0 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:02.454722 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e471db21-f59d-4f86-ac8c-2b85dcd1ffd0 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:02.551627 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-e471db21-f59d-4f86-ac8c-2b85dcd1ffd0 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action" status: 200 len: 28675 microversion: 2.1 time: 0.110780 Dec 14 03:24:02.552259 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 584/1143] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:24:02 2021] POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action => generated 28675 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:24:03.204864 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-26513608-41d9-4746-8e93-1868e9eea64a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:24:03.205472 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-26513608-41d9-4746-8e93-1868e9eea64a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:24:03.211709 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-26513608-41d9-4746-8e93-1868e9eea64a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:03.212157 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-26513608-41d9-4746-8e93-1868e9eea64a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:03.212929 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-26513608-41d9-4746-8e93-1868e9eea64a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:03.213364 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-26513608-41d9-4746-8e93-1868e9eea64a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:03.348199 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-26513608-41d9-4746-8e93-1868e9eea64a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:03.356608 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-26513608-41d9-4746-8e93-1868e9eea64a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:03.358376 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-26513608-41d9-4746-8e93-1868e9eea64a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:03.359570 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-26513608-41d9-4746-8e93-1868e9eea64a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f" status: 200 len: 1739 microversion: 2.20 time: 0.158305 Dec 14 03:24:03.360378 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 560/1144] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:24:03 2021] GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f => generated 1739 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:24:03.564299 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-3a0da5fb-3053-4c9d-b8df-6bddbe9890b3 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:24:03.565307 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-3a0da5fb-3053-4c9d-b8df-6bddbe9890b3 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:24:03.572430 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3a0da5fb-3053-4c9d-b8df-6bddbe9890b3 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:03.572873 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3a0da5fb-3053-4c9d-b8df-6bddbe9890b3 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:03.573653 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3a0da5fb-3053-4c9d-b8df-6bddbe9890b3 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:03.574084 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3a0da5fb-3053-4c9d-b8df-6bddbe9890b3 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:03.671947 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-3a0da5fb-3053-4c9d-b8df-6bddbe9890b3 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action" status: 200 len: 28844 microversion: 2.1 time: 0.111395 Dec 14 03:24:03.674297 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 585/1145] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:24:03 2021] POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action => generated 28844 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:24:04.378099 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-13b42e8a-15e7-4702-9e2e-c1157f204396 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:24:04.381262 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-13b42e8a-15e7-4702-9e2e-c1157f204396 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:24:04.388400 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-13b42e8a-15e7-4702-9e2e-c1157f204396 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:04.388948 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-13b42e8a-15e7-4702-9e2e-c1157f204396 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:04.390227 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-13b42e8a-15e7-4702-9e2e-c1157f204396 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:04.390678 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-13b42e8a-15e7-4702-9e2e-c1157f204396 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:04.547277 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-13b42e8a-15e7-4702-9e2e-c1157f204396 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:04.556234 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-13b42e8a-15e7-4702-9e2e-c1157f204396 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:04.557742 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-13b42e8a-15e7-4702-9e2e-c1157f204396 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:04.558917 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-13b42e8a-15e7-4702-9e2e-c1157f204396 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f" status: 200 len: 1739 microversion: 2.20 time: 0.185064 Dec 14 03:24:04.559508 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 561/1146] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:24:04 2021] GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f => generated 1739 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:24:04.686957 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-19eeea87-a6c5-4f11-adff-701955a97e0e tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:24:04.688165 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-19eeea87-a6c5-4f11-adff-701955a97e0e tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:24:04.696124 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-19eeea87-a6c5-4f11-adff-701955a97e0e tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:04.696717 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-19eeea87-a6c5-4f11-adff-701955a97e0e tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:04.697592 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-19eeea87-a6c5-4f11-adff-701955a97e0e tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:04.698134 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-19eeea87-a6c5-4f11-adff-701955a97e0e tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:04.796060 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-19eeea87-a6c5-4f11-adff-701955a97e0e tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action" status: 200 len: 30465 microversion: 2.1 time: 0.112925 Dec 14 03:24:04.797497 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 586/1147] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:24:04 2021] POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action => generated 30465 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:24:05.579202 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-70e32d55-1ec9-4f25-ad44-7cbe8d8277b1 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:24:05.580491 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-70e32d55-1ec9-4f25-ad44-7cbe8d8277b1 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:24:05.589808 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-70e32d55-1ec9-4f25-ad44-7cbe8d8277b1 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:05.590258 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-70e32d55-1ec9-4f25-ad44-7cbe8d8277b1 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:05.591890 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-70e32d55-1ec9-4f25-ad44-7cbe8d8277b1 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:05.594361 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-70e32d55-1ec9-4f25-ad44-7cbe8d8277b1 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:05.743902 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-70e32d55-1ec9-4f25-ad44-7cbe8d8277b1 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:05.752374 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-70e32d55-1ec9-4f25-ad44-7cbe8d8277b1 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:05.753905 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-70e32d55-1ec9-4f25-ad44-7cbe8d8277b1 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:05.755372 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-70e32d55-1ec9-4f25-ad44-7cbe8d8277b1 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f" status: 200 len: 1739 microversion: 2.20 time: 0.180602 Dec 14 03:24:05.755976 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 562/1148] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:24:05 2021] GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f => generated 1739 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:24:05.808511 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-adde875f-215e-4e91-b2c5-36c3e573cc9d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:24:05.809519 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-adde875f-215e-4e91-b2c5-36c3e573cc9d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:24:05.816595 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-adde875f-215e-4e91-b2c5-36c3e573cc9d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:05.817046 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-adde875f-215e-4e91-b2c5-36c3e573cc9d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:05.818090 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-adde875f-215e-4e91-b2c5-36c3e573cc9d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:05.818538 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-adde875f-215e-4e91-b2c5-36c3e573cc9d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:05.919627 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-adde875f-215e-4e91-b2c5-36c3e573cc9d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action" status: 200 len: 32103 microversion: 2.1 time: 0.114854 Dec 14 03:24:05.920195 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 587/1149] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:24:05 2021] POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action => generated 32103 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:24:06.774219 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-f344f449-b6b4-4ef1-959e-5a1960f5d10e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:24:06.774837 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-f344f449-b6b4-4ef1-959e-5a1960f5d10e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:24:06.783148 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-f344f449-b6b4-4ef1-959e-5a1960f5d10e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:06.783604 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-f344f449-b6b4-4ef1-959e-5a1960f5d10e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:06.784405 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-f344f449-b6b4-4ef1-959e-5a1960f5d10e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:06.784838 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-f344f449-b6b4-4ef1-959e-5a1960f5d10e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:06.925120 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-f344f449-b6b4-4ef1-959e-5a1960f5d10e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:06.932437 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-2fc9dad2-5353-42f8-9e04-75e9075288c7 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:24:06.933580 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-2fc9dad2-5353-42f8-9e04-75e9075288c7 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:24:06.939962 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-f344f449-b6b4-4ef1-959e-5a1960f5d10e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:06.940898 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2fc9dad2-5353-42f8-9e04-75e9075288c7 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:06.941621 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-f344f449-b6b4-4ef1-959e-5a1960f5d10e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:06.941887 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2fc9dad2-5353-42f8-9e04-75e9075288c7 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:06.942834 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-f344f449-b6b4-4ef1-959e-5a1960f5d10e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f" status: 200 len: 1739 microversion: 2.20 time: 0.173169 Dec 14 03:24:06.943728 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2fc9dad2-5353-42f8-9e04-75e9075288c7 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:06.944413 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2fc9dad2-5353-42f8-9e04-75e9075288c7 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:06.955234 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 563/1150] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:24:06 2021] GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f => generated 1739 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:24:07.056959 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-2fc9dad2-5353-42f8-9e04-75e9075288c7 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action" status: 200 len: 33294 microversion: 2.1 time: 0.128458 Dec 14 03:24:07.061113 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 588/1151] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:24:06 2021] POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action => generated 33294 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 14 03:24:07.968027 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-005a51d9-17ed-42bf-a99f-b15b300b919b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:24:07.968565 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-005a51d9-17ed-42bf-a99f-b15b300b919b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:24:07.976489 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-005a51d9-17ed-42bf-a99f-b15b300b919b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:07.977478 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-005a51d9-17ed-42bf-a99f-b15b300b919b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:07.978065 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-005a51d9-17ed-42bf-a99f-b15b300b919b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:07.978512 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-005a51d9-17ed-42bf-a99f-b15b300b919b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:08.070127 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-43b8dd77-90d1-47f0-b932-ad3292c324d6 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:24:08.072006 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-43b8dd77-90d1-47f0-b932-ad3292c324d6 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:24:08.080587 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-43b8dd77-90d1-47f0-b932-ad3292c324d6 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:08.081308 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-43b8dd77-90d1-47f0-b932-ad3292c324d6 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:08.082405 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-43b8dd77-90d1-47f0-b932-ad3292c324d6 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:08.083236 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-43b8dd77-90d1-47f0-b932-ad3292c324d6 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:08.119821 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-005a51d9-17ed-42bf-a99f-b15b300b919b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:08.128764 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-005a51d9-17ed-42bf-a99f-b15b300b919b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:08.130293 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-005a51d9-17ed-42bf-a99f-b15b300b919b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:08.132010 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-005a51d9-17ed-42bf-a99f-b15b300b919b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f" status: 200 len: 1739 microversion: 2.20 time: 0.169370 Dec 14 03:24:08.132564 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 564/1152] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:24:07 2021] GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f => generated 1739 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:24:08.182957 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-43b8dd77-90d1-47f0-b932-ad3292c324d6 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action" status: 200 len: 34015 microversion: 2.1 time: 0.117465 Dec 14 03:24:08.183893 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 589/1153] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:24:08 2021] POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action => generated 34015 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:24:09.152682 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-462eedb7-67fd-4e2b-a8d9-ec499c069f4e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:24:09.153333 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-462eedb7-67fd-4e2b-a8d9-ec499c069f4e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:24:09.159676 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-462eedb7-67fd-4e2b-a8d9-ec499c069f4e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:09.160218 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-462eedb7-67fd-4e2b-a8d9-ec499c069f4e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:09.162144 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-462eedb7-67fd-4e2b-a8d9-ec499c069f4e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:09.162587 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-462eedb7-67fd-4e2b-a8d9-ec499c069f4e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:09.196255 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-ebd090c8-e7db-4e13-8941-3d1313db19ee tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:24:09.197885 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-ebd090c8-e7db-4e13-8941-3d1313db19ee tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:24:09.205734 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ebd090c8-e7db-4e13-8941-3d1313db19ee tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:09.206454 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ebd090c8-e7db-4e13-8941-3d1313db19ee tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:09.207537 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ebd090c8-e7db-4e13-8941-3d1313db19ee tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:09.208167 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ebd090c8-e7db-4e13-8941-3d1313db19ee tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:09.304420 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-462eedb7-67fd-4e2b-a8d9-ec499c069f4e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:09.313372 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-462eedb7-67fd-4e2b-a8d9-ec499c069f4e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:09.314894 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-462eedb7-67fd-4e2b-a8d9-ec499c069f4e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:09.316367 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-462eedb7-67fd-4e2b-a8d9-ec499c069f4e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f" status: 200 len: 1739 microversion: 2.20 time: 0.168215 Dec 14 03:24:09.316930 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 565/1154] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:24:09 2021] GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f => generated 1739 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:24:09.320146 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-ebd090c8-e7db-4e13-8941-3d1313db19ee tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action" status: 200 len: 35105 microversion: 2.1 time: 0.128107 Dec 14 03:24:09.320991 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 590/1155] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:24:09 2021] POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action => generated 35105 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 14 03:24:10.338350 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-ebf209d3-4327-4ecd-80de-8f95295fb6d5 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:24:10.342872 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-0d591e50-7bf7-480e-851f-5fa8ae390153 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:24:10.343619 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-0d591e50-7bf7-480e-851f-5fa8ae390153 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:24:10.348142 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-ebf209d3-4327-4ecd-80de-8f95295fb6d5 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:24:10.355114 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ebf209d3-4327-4ecd-80de-8f95295fb6d5 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:10.355575 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ebf209d3-4327-4ecd-80de-8f95295fb6d5 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:10.356611 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ebf209d3-4327-4ecd-80de-8f95295fb6d5 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:10.357233 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ebf209d3-4327-4ecd-80de-8f95295fb6d5 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:10.365561 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0d591e50-7bf7-480e-851f-5fa8ae390153 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:10.366024 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0d591e50-7bf7-480e-851f-5fa8ae390153 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:10.366818 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0d591e50-7bf7-480e-851f-5fa8ae390153 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:10.367293 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0d591e50-7bf7-480e-851f-5fa8ae390153 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:10.486051 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-ebf209d3-4327-4ecd-80de-8f95295fb6d5 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action" status: 200 len: 36294 microversion: 2.1 time: 0.157382 Dec 14 03:24:10.492733 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 566/1156] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:24:10 2021] POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action => generated 36294 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:24:10.565187 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-0d591e50-7bf7-480e-851f-5fa8ae390153 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:10.578492 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-0d591e50-7bf7-480e-851f-5fa8ae390153 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:10.580164 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-0d591e50-7bf7-480e-851f-5fa8ae390153 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:10.581502 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-0d591e50-7bf7-480e-851f-5fa8ae390153 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f" status: 200 len: 1739 microversion: 2.20 time: 0.248595 Dec 14 03:24:10.582134 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 591/1157] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:24:10 2021] GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f => generated 1739 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:24:11.501260 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-a20c5c0b-97ca-49ae-bb92-1da7e0fe3514 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:24:11.502276 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-a20c5c0b-97ca-49ae-bb92-1da7e0fe3514 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:24:11.509674 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a20c5c0b-97ca-49ae-bb92-1da7e0fe3514 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:11.510132 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a20c5c0b-97ca-49ae-bb92-1da7e0fe3514 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:11.510925 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a20c5c0b-97ca-49ae-bb92-1da7e0fe3514 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:11.511392 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a20c5c0b-97ca-49ae-bb92-1da7e0fe3514 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:11.608962 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-a20c5c0b-97ca-49ae-bb92-1da7e0fe3514 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action" status: 200 len: 37717 microversion: 2.1 time: 0.111085 Dec 14 03:24:11.612095 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 567/1158] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:24:11 2021] POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action => generated 37717 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:24:11.620316 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-b8000449-951a-4f83-8ce8-477ae40404ee tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:24:11.622221 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-b8000449-951a-4f83-8ce8-477ae40404ee tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:24:11.630579 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b8000449-951a-4f83-8ce8-477ae40404ee tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:11.631753 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b8000449-951a-4f83-8ce8-477ae40404ee tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:11.633143 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b8000449-951a-4f83-8ce8-477ae40404ee tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:11.633987 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b8000449-951a-4f83-8ce8-477ae40404ee tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:11.777964 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-b8000449-951a-4f83-8ce8-477ae40404ee tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:11.785689 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-b8000449-951a-4f83-8ce8-477ae40404ee tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:11.788380 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-b8000449-951a-4f83-8ce8-477ae40404ee tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:11.789566 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-b8000449-951a-4f83-8ce8-477ae40404ee tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f" status: 200 len: 1739 microversion: 2.20 time: 0.191792 Dec 14 03:24:11.790135 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 592/1159] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:24:11 2021] GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f => generated 1739 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:24:12.622282 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-e58eedac-7339-49aa-b5b6-5ea1c40fcaea tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:24:12.624094 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-e58eedac-7339-49aa-b5b6-5ea1c40fcaea tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:24:12.633027 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-e58eedac-7339-49aa-b5b6-5ea1c40fcaea tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:12.633792 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-e58eedac-7339-49aa-b5b6-5ea1c40fcaea tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:12.634732 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-e58eedac-7339-49aa-b5b6-5ea1c40fcaea tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:12.635244 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-e58eedac-7339-49aa-b5b6-5ea1c40fcaea tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:12.730822 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-e58eedac-7339-49aa-b5b6-5ea1c40fcaea tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action" status: 200 len: 38196 microversion: 2.1 time: 0.113665 Dec 14 03:24:12.735310 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 568/1160] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:24:12 2021] POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action => generated 38196 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 14 03:24:12.807860 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-5b987d12-4452-416c-8a81-6a43d29bcb08 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:24:12.808469 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-5b987d12-4452-416c-8a81-6a43d29bcb08 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:24:12.816447 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5b987d12-4452-416c-8a81-6a43d29bcb08 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:12.816997 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5b987d12-4452-416c-8a81-6a43d29bcb08 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:12.818487 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5b987d12-4452-416c-8a81-6a43d29bcb08 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:12.818930 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5b987d12-4452-416c-8a81-6a43d29bcb08 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:12.966242 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-5b987d12-4452-416c-8a81-6a43d29bcb08 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:12.974747 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-5b987d12-4452-416c-8a81-6a43d29bcb08 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:12.976515 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-5b987d12-4452-416c-8a81-6a43d29bcb08 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:12.978196 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-5b987d12-4452-416c-8a81-6a43d29bcb08 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f" status: 200 len: 1739 microversion: 2.20 time: 0.173974 Dec 14 03:24:12.979002 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 593/1161] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:24:12 2021] GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f => generated 1739 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 14 03:24:13.744314 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-a92cfd34-e7f7-4aca-81de-68fb0a5402b3 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:24:13.745352 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-a92cfd34-e7f7-4aca-81de-68fb0a5402b3 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:24:13.752157 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a92cfd34-e7f7-4aca-81de-68fb0a5402b3 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:13.752609 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a92cfd34-e7f7-4aca-81de-68fb0a5402b3 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:13.753388 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a92cfd34-e7f7-4aca-81de-68fb0a5402b3 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:13.753834 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a92cfd34-e7f7-4aca-81de-68fb0a5402b3 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:13.926030 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-a92cfd34-e7f7-4aca-81de-68fb0a5402b3 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action" status: 200 len: 38196 microversion: 2.1 time: 0.186124 Dec 14 03:24:13.926606 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 569/1162] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:24:13 2021] POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action => generated 38196 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:24:13.996803 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-bee22e79-9304-49f8-91c3-ede44f0ae319 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:24:13.997408 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-bee22e79-9304-49f8-91c3-ede44f0ae319 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:24:14.003591 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-bee22e79-9304-49f8-91c3-ede44f0ae319 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:14.004034 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-bee22e79-9304-49f8-91c3-ede44f0ae319 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:14.004797 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-bee22e79-9304-49f8-91c3-ede44f0ae319 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:14.005225 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-bee22e79-9304-49f8-91c3-ede44f0ae319 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:14.131461 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-bee22e79-9304-49f8-91c3-ede44f0ae319 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:14.139002 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-bee22e79-9304-49f8-91c3-ede44f0ae319 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:14.140509 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-bee22e79-9304-49f8-91c3-ede44f0ae319 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:14.141651 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-bee22e79-9304-49f8-91c3-ede44f0ae319 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f" status: 200 len: 1739 microversion: 2.20 time: 0.148640 Dec 14 03:24:14.142199 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 594/1163] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:24:13 2021] GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f => generated 1739 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:24:14.938223 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-4f701a5b-0679-497e-92a6-23ae52cdcb5c tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:24:14.939263 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-4f701a5b-0679-497e-92a6-23ae52cdcb5c tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:24:14.946018 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-4f701a5b-0679-497e-92a6-23ae52cdcb5c tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:14.946470 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-4f701a5b-0679-497e-92a6-23ae52cdcb5c tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:14.947282 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-4f701a5b-0679-497e-92a6-23ae52cdcb5c tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:14.947721 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-4f701a5b-0679-497e-92a6-23ae52cdcb5c tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:15.036146 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-4f701a5b-0679-497e-92a6-23ae52cdcb5c tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action" status: 200 len: 38196 microversion: 2.1 time: 0.101899 Dec 14 03:24:15.037309 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 570/1164] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:24:14 2021] POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action => generated 38196 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:24:15.160158 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-8585ba3a-5e24-4094-83ae-e04f32f77478 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:24:15.160760 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-8585ba3a-5e24-4094-83ae-e04f32f77478 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:24:15.167453 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8585ba3a-5e24-4094-83ae-e04f32f77478 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:15.167899 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8585ba3a-5e24-4094-83ae-e04f32f77478 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:15.168662 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8585ba3a-5e24-4094-83ae-e04f32f77478 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:15.169089 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8585ba3a-5e24-4094-83ae-e04f32f77478 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:15.295263 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-8585ba3a-5e24-4094-83ae-e04f32f77478 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:15.302814 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-8585ba3a-5e24-4094-83ae-e04f32f77478 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:15.304333 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-8585ba3a-5e24-4094-83ae-e04f32f77478 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:15.305483 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-8585ba3a-5e24-4094-83ae-e04f32f77478 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f" status: 200 len: 1721 microversion: 2.20 time: 0.148973 Dec 14 03:24:15.306046 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 595/1165] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:24:15 2021] GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f => generated 1721 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:24:16.048898 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-344e3b70-cdfe-42a7-a2f8-e827bbac62e4 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:24:16.049814 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-344e3b70-cdfe-42a7-a2f8-e827bbac62e4 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:24:16.056602 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-344e3b70-cdfe-42a7-a2f8-e827bbac62e4 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:16.057050 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-344e3b70-cdfe-42a7-a2f8-e827bbac62e4 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:16.057822 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-344e3b70-cdfe-42a7-a2f8-e827bbac62e4 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:16.058257 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-344e3b70-cdfe-42a7-a2f8-e827bbac62e4 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:16.150280 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-344e3b70-cdfe-42a7-a2f8-e827bbac62e4 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action" status: 200 len: 38325 microversion: 2.1 time: 0.105320 Dec 14 03:24:16.150940 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 571/1166] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:24:16 2021] POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/action => generated 38325 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 14 03:24:16.160398 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-3d684ee4-77a8-44ed-9a01-1d19f8462ecc tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:24:16.160870 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-3d684ee4-77a8-44ed-9a01-1d19f8462ecc tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:24:16.167430 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3d684ee4-77a8-44ed-9a01-1d19f8462ecc tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:16.167877 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3d684ee4-77a8-44ed-9a01-1d19f8462ecc tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:16.168641 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3d684ee4-77a8-44ed-9a01-1d19f8462ecc tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:16.169097 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3d684ee4-77a8-44ed-9a01-1d19f8462ecc tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:16.191165 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-3d684ee4-77a8-44ed-9a01-1d19f8462ecc tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/ips" status: 200 len: 145 microversion: 2.1 time: 0.034311 Dec 14 03:24:16.191698 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 596/1167] 10.222.0.43 () {58 vars in 1247 bytes} [Tue Dec 14 03:24:16 2021] GET /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/ips => generated 145 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:24:16.324267 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-aaec5d54-aa47-4468-abae-2a8e6069a270 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:24:16.325019 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-aaec5d54-aa47-4468-abae-2a8e6069a270 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:24:16.332120 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-aaec5d54-aa47-4468-abae-2a8e6069a270 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:16.332578 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-aaec5d54-aa47-4468-abae-2a8e6069a270 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:16.333959 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-aaec5d54-aa47-4468-abae-2a8e6069a270 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:16.334335 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-aaec5d54-aa47-4468-abae-2a8e6069a270 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:16.478142 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-aaec5d54-aa47-4468-abae-2a8e6069a270 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:16.486051 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-aaec5d54-aa47-4468-abae-2a8e6069a270 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:16.487827 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-aaec5d54-aa47-4468-abae-2a8e6069a270 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:16.488988 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-aaec5d54-aa47-4468-abae-2a8e6069a270 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f" status: 200 len: 1721 microversion: 2.20 time: 0.168738 Dec 14 03:24:16.489565 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 572/1168] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:24:16 2021] GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:24:17.233746 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [req-33895bb5-4b5c-4e14-8341-64c20f1d5999 req-1297447b-b253-4edd-9fb8-47633dc3b85f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "279d5888-562c-4c6a-b27c-3f8e84fd510f", "name": "network-vif-unplugged", "status": "completed", "tag": "9eee83b0-b14c-403e-a6bd-7d2515f7e214"}]} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:24:17.235295 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:24:17.235295 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: warnings.warn(msg) Dec 14 03:24:17.243593 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-33895bb5-4b5c-4e14-8341-64c20f1d5999 req-1297447b-b253-4edd-9fb8-47633dc3b85f service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:17.243948 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-33895bb5-4b5c-4e14-8341-64c20f1d5999 req-1297447b-b253-4edd-9fb8-47633dc3b85f service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:17.255649 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.compute.server_external_events [req-33895bb5-4b5c-4e14-8341-64c20f1d5999 req-1297447b-b253-4edd-9fb8-47633dc3b85f service nova] Unable to find a host for instance 279d5888-562c-4c6a-b27c-3f8e84fd510f. Dropping event network-vif-unplugged {{(pid=116072) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Dec 14 03:24:17.256509 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [req-33895bb5-4b5c-4e14-8341-64c20f1d5999 req-1297447b-b253-4edd-9fb8-47633dc3b85f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026628 Dec 14 03:24:17.257077 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 597/1169] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Dec 14 03:24:17 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Dec 14 03:24:17.488823 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-2ee6986b-a3be-45bf-93fc-554a90426a6f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0861217c-fbd5-4c03-82a6-e3f3a2887a82"}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:24:17.490474 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-2ee6986b-a3be-45bf-93fc-554a90426a6f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:24:17.496757 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-2ee6986b-a3be-45bf-93fc-554a90426a6f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:17.497210 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-2ee6986b-a3be-45bf-93fc-554a90426a6f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:17.497990 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-2ee6986b-a3be-45bf-93fc-554a90426a6f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:17.498429 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-2ee6986b-a3be-45bf-93fc-554a90426a6f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:17.506945 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-a81ebc6f-1919-462c-a41a-d177d5771f27 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:24:17.507817 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-a81ebc6f-1919-462c-a41a-d177d5771f27 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:24:17.513646 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a81ebc6f-1919-462c-a41a-d177d5771f27 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:17.514185 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a81ebc6f-1919-462c-a41a-d177d5771f27 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:17.515030 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a81ebc6f-1919-462c-a41a-d177d5771f27 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:17.515561 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a81ebc6f-1919-462c-a41a-d177d5771f27 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:17.643127 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-a81ebc6f-1919-462c-a41a-d177d5771f27 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:17.651441 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-a81ebc6f-1919-462c-a41a-d177d5771f27 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:17.652929 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-a81ebc6f-1919-462c-a41a-d177d5771f27 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:17.654081 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-a81ebc6f-1919-462c-a41a-d177d5771f27 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f" status: 200 len: 1664 microversion: 2.20 time: 0.150869 Dec 14 03:24:17.654632 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 598/1170] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:24:17 2021] GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f => generated 1664 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 14 03:24:17.672304 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-948e07f5-a0ae-4769-a823-dc29d06ef705 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d62134ec-0577-4d7a-9b96-0537c8bbaeeb"}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:24:17.673229 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-948e07f5-a0ae-4769-a823-dc29d06ef705 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:24:17.679493 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-948e07f5-a0ae-4769-a823-dc29d06ef705 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:17.679940 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-948e07f5-a0ae-4769-a823-dc29d06ef705 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:17.680719 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-948e07f5-a0ae-4769-a823-dc29d06ef705 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:17.681154 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-948e07f5-a0ae-4769-a823-dc29d06ef705 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:17.755862 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-2ee6986b-a3be-45bf-93fc-554a90426a6f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.270885 Dec 14 03:24:17.756467 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 573/1171] 10.222.0.43 () {60 vars in 1322 bytes} [Tue Dec 14 03:24:17 2021] POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/os-volume_attachments => generated 194 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:24:17.947535 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-948e07f5-a0ae-4769-a823-dc29d06ef705 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.279009 Dec 14 03:24:17.948152 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 599/1172] 10.222.0.43 () {62 vars in 1363 bytes} [Tue Dec 14 03:24:17 2021] POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/os-volume_attachments => generated 188 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 03:24:18.059826 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-78b7d237-eb79-4e50-86f0-343d1c3478c4 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:24:18.060417 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-78b7d237-eb79-4e50-86f0-343d1c3478c4 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:24:18.066836 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-78b7d237-eb79-4e50-86f0-343d1c3478c4 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:18.067330 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-78b7d237-eb79-4e50-86f0-343d1c3478c4 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:18.068606 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-78b7d237-eb79-4e50-86f0-343d1c3478c4 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:18.069045 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-78b7d237-eb79-4e50-86f0-343d1c3478c4 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:18.365647 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-78b7d237-eb79-4e50-86f0-343d1c3478c4 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "DELETE /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/os-volume_attachments/d62134ec-0577-4d7a-9b96-0537c8bbaeeb" status: 202 len: 0 microversion: 2.20 time: 0.309782 Dec 14 03:24:18.366244 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 574/1173] 10.222.0.43 () {60 vars in 1456 bytes} [Tue Dec 14 03:24:18 2021] DELETE /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/os-volume_attachments/d62134ec-0577-4d7a-9b96-0537c8bbaeeb => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 14 03:24:18.419435 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-afd95a4c-ddfc-4040-b90d-6db049d77896 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:24:18.420020 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-afd95a4c-ddfc-4040-b90d-6db049d77896 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:24:18.426248 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-afd95a4c-ddfc-4040-b90d-6db049d77896 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:18.426697 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-afd95a4c-ddfc-4040-b90d-6db049d77896 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:18.428051 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-afd95a4c-ddfc-4040-b90d-6db049d77896 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:18.428495 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-afd95a4c-ddfc-4040-b90d-6db049d77896 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:18.515922 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-afd95a4c-ddfc-4040-b90d-6db049d77896 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action" status: 202 len: 0 microversion: 2.20 time: 0.100165 Dec 14 03:24:18.516529 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 600/1174] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Dec 14 03:24:18 2021] POST /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 14 03:24:18.524499 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-692ba68b-da34-4567-ab98-dda1a9e30687 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:24:18.525113 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-692ba68b-da34-4567-ab98-dda1a9e30687 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:24:18.532188 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-692ba68b-da34-4567-ab98-dda1a9e30687 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:18.532641 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-692ba68b-da34-4567-ab98-dda1a9e30687 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:18.533423 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-692ba68b-da34-4567-ab98-dda1a9e30687 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:18.533863 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-692ba68b-da34-4567-ab98-dda1a9e30687 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:18.679007 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-692ba68b-da34-4567-ab98-dda1a9e30687 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:18.687469 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-692ba68b-da34-4567-ab98-dda1a9e30687 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:18.688982 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-692ba68b-da34-4567-ab98-dda1a9e30687 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:18.690208 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-692ba68b-da34-4567-ab98-dda1a9e30687 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f" status: 200 len: 1672 microversion: 2.20 time: 0.169523 Dec 14 03:24:18.690779 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 575/1175] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:24:18 2021] GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f => generated 1672 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 14 03:24:19.710011 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-25ca9298-a365-46ba-9554-9758eb679e6a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:24:19.710629 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-25ca9298-a365-46ba-9554-9758eb679e6a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:24:19.717390 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-25ca9298-a365-46ba-9554-9758eb679e6a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:19.717845 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-25ca9298-a365-46ba-9554-9758eb679e6a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:19.718632 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-25ca9298-a365-46ba-9554-9758eb679e6a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:19.719097 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-25ca9298-a365-46ba-9554-9758eb679e6a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:19.847107 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-25ca9298-a365-46ba-9554-9758eb679e6a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:19.855521 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-25ca9298-a365-46ba-9554-9758eb679e6a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:19.856989 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-25ca9298-a365-46ba-9554-9758eb679e6a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:19.858557 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-25ca9298-a365-46ba-9554-9758eb679e6a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f" status: 200 len: 1730 microversion: 2.20 time: 0.152879 Dec 14 03:24:19.859146 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 601/1176] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:24:19 2021] GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:24:20.877203 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-841b6987-697f-4f1b-8907-7cabf56e00ac tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:24:20.877807 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-841b6987-697f-4f1b-8907-7cabf56e00ac tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:24:20.885080 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-841b6987-697f-4f1b-8907-7cabf56e00ac tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:20.885723 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-841b6987-697f-4f1b-8907-7cabf56e00ac tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:20.886609 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-841b6987-697f-4f1b-8907-7cabf56e00ac tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:20.887260 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-841b6987-697f-4f1b-8907-7cabf56e00ac tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:21.030926 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-841b6987-697f-4f1b-8907-7cabf56e00ac tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:21.040384 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-841b6987-697f-4f1b-8907-7cabf56e00ac tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:21.041885 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-841b6987-697f-4f1b-8907-7cabf56e00ac tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:21.043272 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-841b6987-697f-4f1b-8907-7cabf56e00ac tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f" status: 200 len: 1730 microversion: 2.20 time: 0.169680 Dec 14 03:24:21.044138 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 576/1177] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:24:20 2021] GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:24:22.061771 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-6ea18764-811f-4d97-b279-208e3b6c28af tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:24:22.064466 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-6ea18764-811f-4d97-b279-208e3b6c28af tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:24:22.069449 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6ea18764-811f-4d97-b279-208e3b6c28af tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:22.069886 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6ea18764-811f-4d97-b279-208e3b6c28af tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:22.070665 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6ea18764-811f-4d97-b279-208e3b6c28af tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:22.071135 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6ea18764-811f-4d97-b279-208e3b6c28af tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:22.204794 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-6ea18764-811f-4d97-b279-208e3b6c28af tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:22.213571 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-6ea18764-811f-4d97-b279-208e3b6c28af tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:22.215713 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-6ea18764-811f-4d97-b279-208e3b6c28af tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:22.217230 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-6ea18764-811f-4d97-b279-208e3b6c28af tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f" status: 200 len: 1730 microversion: 2.20 time: 0.159184 Dec 14 03:24:22.218290 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 602/1178] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:24:22 2021] GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:24:23.235675 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-ebb66f5b-cf23-40ea-b415-2a6b29e96629 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:24:23.236289 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-ebb66f5b-cf23-40ea-b415-2a6b29e96629 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:24:23.243213 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ebb66f5b-cf23-40ea-b415-2a6b29e96629 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:23.243665 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ebb66f5b-cf23-40ea-b415-2a6b29e96629 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:23.244454 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ebb66f5b-cf23-40ea-b415-2a6b29e96629 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:23.244897 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ebb66f5b-cf23-40ea-b415-2a6b29e96629 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:23.372868 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-ebb66f5b-cf23-40ea-b415-2a6b29e96629 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:23.381078 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-ebb66f5b-cf23-40ea-b415-2a6b29e96629 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:23.382572 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-ebb66f5b-cf23-40ea-b415-2a6b29e96629 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:23.383762 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-ebb66f5b-cf23-40ea-b415-2a6b29e96629 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f" status: 200 len: 1730 microversion: 2.20 time: 0.151808 Dec 14 03:24:23.384318 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 577/1179] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:24:23 2021] GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:24:24.401548 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-bbc46b38-e1b1-4864-9096-3d4945f9b507 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:24:24.402164 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-bbc46b38-e1b1-4864-9096-3d4945f9b507 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:24:24.408419 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-bbc46b38-e1b1-4864-9096-3d4945f9b507 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:24.408865 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-bbc46b38-e1b1-4864-9096-3d4945f9b507 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:24.409634 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-bbc46b38-e1b1-4864-9096-3d4945f9b507 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:24.410062 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-bbc46b38-e1b1-4864-9096-3d4945f9b507 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:24.564057 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-bbc46b38-e1b1-4864-9096-3d4945f9b507 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:24.572309 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-bbc46b38-e1b1-4864-9096-3d4945f9b507 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:24.573806 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-bbc46b38-e1b1-4864-9096-3d4945f9b507 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:24.574956 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-bbc46b38-e1b1-4864-9096-3d4945f9b507 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f" status: 200 len: 1730 microversion: 2.20 time: 0.177109 Dec 14 03:24:24.575535 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 603/1180] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:24:24 2021] GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f => generated 1730 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:24:25.592339 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-e5307b94-fc13-4279-bd80-37c46af1cb21 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:24:25.592937 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-e5307b94-fc13-4279-bd80-37c46af1cb21 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:24:25.599999 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-e5307b94-fc13-4279-bd80-37c46af1cb21 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:25.600451 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-e5307b94-fc13-4279-bd80-37c46af1cb21 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:25.601238 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-e5307b94-fc13-4279-bd80-37c46af1cb21 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:25.601674 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-e5307b94-fc13-4279-bd80-37c46af1cb21 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:25.735342 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-e5307b94-fc13-4279-bd80-37c46af1cb21 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:25.745300 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-e5307b94-fc13-4279-bd80-37c46af1cb21 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:25.746934 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-e5307b94-fc13-4279-bd80-37c46af1cb21 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:25.748262 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-e5307b94-fc13-4279-bd80-37c46af1cb21 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f" status: 200 len: 1730 microversion: 2.20 time: 0.159651 Dec 14 03:24:25.748973 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 578/1181] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:24:25 2021] GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:24:26.766824 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-b3b29bda-0509-4e0f-9355-b0fdc45a6958 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:24:26.767531 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-b3b29bda-0509-4e0f-9355-b0fdc45a6958 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:24:26.774111 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b3b29bda-0509-4e0f-9355-b0fdc45a6958 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:26.774519 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b3b29bda-0509-4e0f-9355-b0fdc45a6958 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:26.775325 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b3b29bda-0509-4e0f-9355-b0fdc45a6958 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:26.775765 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b3b29bda-0509-4e0f-9355-b0fdc45a6958 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:26.905463 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-b3b29bda-0509-4e0f-9355-b0fdc45a6958 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:26.913698 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-b3b29bda-0509-4e0f-9355-b0fdc45a6958 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:26.915248 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-b3b29bda-0509-4e0f-9355-b0fdc45a6958 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:26.916435 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-b3b29bda-0509-4e0f-9355-b0fdc45a6958 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f" status: 200 len: 1730 microversion: 2.20 time: 0.153307 Dec 14 03:24:26.917231 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 604/1182] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:24:26 2021] GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:24:27.935632 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-c1ee1e5f-7fd1-4686-9856-bf6337880e51 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:24:27.936181 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-c1ee1e5f-7fd1-4686-9856-bf6337880e51 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:24:27.942537 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c1ee1e5f-7fd1-4686-9856-bf6337880e51 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:27.942986 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c1ee1e5f-7fd1-4686-9856-bf6337880e51 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:27.944044 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c1ee1e5f-7fd1-4686-9856-bf6337880e51 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:27.944486 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c1ee1e5f-7fd1-4686-9856-bf6337880e51 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:28.075508 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-c1ee1e5f-7fd1-4686-9856-bf6337880e51 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:28.084141 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-c1ee1e5f-7fd1-4686-9856-bf6337880e51 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:28.085644 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-c1ee1e5f-7fd1-4686-9856-bf6337880e51 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:28.086812 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-c1ee1e5f-7fd1-4686-9856-bf6337880e51 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f" status: 200 len: 1730 microversion: 2.20 time: 0.155049 Dec 14 03:24:28.087594 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 579/1183] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:24:27 2021] GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:24:29.105259 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-8826a076-4ae8-49ef-b3d4-8f714a87c69b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:24:29.105869 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-8826a076-4ae8-49ef-b3d4-8f714a87c69b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:24:29.112471 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8826a076-4ae8-49ef-b3d4-8f714a87c69b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:29.112921 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8826a076-4ae8-49ef-b3d4-8f714a87c69b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:29.113692 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8826a076-4ae8-49ef-b3d4-8f714a87c69b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:29.114128 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8826a076-4ae8-49ef-b3d4-8f714a87c69b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:29.260920 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-8826a076-4ae8-49ef-b3d4-8f714a87c69b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:29.268788 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-8826a076-4ae8-49ef-b3d4-8f714a87c69b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:29.270293 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-8826a076-4ae8-49ef-b3d4-8f714a87c69b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:29.272079 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-8826a076-4ae8-49ef-b3d4-8f714a87c69b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f" status: 200 len: 1730 microversion: 2.20 time: 0.170473 Dec 14 03:24:29.272662 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 605/1184] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:24:29 2021] GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:24:30.291651 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-b298d65e-ebe7-499b-a482-9f9f8b48dbc7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:24:30.292435 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-b298d65e-ebe7-499b-a482-9f9f8b48dbc7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:24:30.300331 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b298d65e-ebe7-499b-a482-9f9f8b48dbc7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:30.300873 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b298d65e-ebe7-499b-a482-9f9f8b48dbc7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:30.302557 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b298d65e-ebe7-499b-a482-9f9f8b48dbc7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:30.303092 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b298d65e-ebe7-499b-a482-9f9f8b48dbc7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:30.692271 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-b298d65e-ebe7-499b-a482-9f9f8b48dbc7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:30.699986 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-b298d65e-ebe7-499b-a482-9f9f8b48dbc7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:30.701477 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-b298d65e-ebe7-499b-a482-9f9f8b48dbc7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:30.702623 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-b298d65e-ebe7-499b-a482-9f9f8b48dbc7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f" status: 200 len: 1730 microversion: 2.20 time: 0.415542 Dec 14 03:24:30.703212 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 580/1185] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:24:30 2021] GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f => generated 1730 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:24:31.720073 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-42f5913f-6287-4710-81df-956f51c6bf24 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:24:31.720726 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-42f5913f-6287-4710-81df-956f51c6bf24 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:24:31.727568 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-42f5913f-6287-4710-81df-956f51c6bf24 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:31.727959 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-42f5913f-6287-4710-81df-956f51c6bf24 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:31.728754 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-42f5913f-6287-4710-81df-956f51c6bf24 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:31.729190 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-42f5913f-6287-4710-81df-956f51c6bf24 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:31.917672 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-42f5913f-6287-4710-81df-956f51c6bf24 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:31.925330 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-42f5913f-6287-4710-81df-956f51c6bf24 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:31.926859 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-42f5913f-6287-4710-81df-956f51c6bf24 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:31.928044 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-42f5913f-6287-4710-81df-956f51c6bf24 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f" status: 200 len: 1730 microversion: 2.20 time: 0.211668 Dec 14 03:24:31.928600 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 606/1186] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:24:31 2021] GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f => generated 1730 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:24:32.946696 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-441b1051-d456-47fa-838a-b37e6c6194b6 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:24:32.947280 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-441b1051-d456-47fa-838a-b37e6c6194b6 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:24:32.953540 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-441b1051-d456-47fa-838a-b37e6c6194b6 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:32.954000 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-441b1051-d456-47fa-838a-b37e6c6194b6 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:32.954787 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-441b1051-d456-47fa-838a-b37e6c6194b6 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:32.955260 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-441b1051-d456-47fa-838a-b37e6c6194b6 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:33.085859 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-441b1051-d456-47fa-838a-b37e6c6194b6 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:33.093528 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-441b1051-d456-47fa-838a-b37e6c6194b6 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:33.095022 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-441b1051-d456-47fa-838a-b37e6c6194b6 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:33.096197 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-441b1051-d456-47fa-838a-b37e6c6194b6 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f" status: 200 len: 1730 microversion: 2.20 time: 0.153834 Dec 14 03:24:33.096757 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 581/1187] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:24:32 2021] GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:24:34.118903 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-58dfca52-80ac-4d4b-a090-9ba7e320cd0e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:24:34.119542 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-58dfca52-80ac-4d4b-a090-9ba7e320cd0e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:24:34.125800 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-58dfca52-80ac-4d4b-a090-9ba7e320cd0e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:34.126247 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-58dfca52-80ac-4d4b-a090-9ba7e320cd0e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:34.127017 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-58dfca52-80ac-4d4b-a090-9ba7e320cd0e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:34.127476 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-58dfca52-80ac-4d4b-a090-9ba7e320cd0e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:34.251504 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-58dfca52-80ac-4d4b-a090-9ba7e320cd0e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:34.259101 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-58dfca52-80ac-4d4b-a090-9ba7e320cd0e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:34.260653 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-58dfca52-80ac-4d4b-a090-9ba7e320cd0e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:34.261811 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-58dfca52-80ac-4d4b-a090-9ba7e320cd0e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f" status: 200 len: 1730 microversion: 2.20 time: 0.146580 Dec 14 03:24:34.262368 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 607/1188] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:24:34 2021] GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f => generated 1730 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:24:35.279369 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-02d598fe-47e6-4a5f-aee3-a0d0738f1e79 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:24:35.279989 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-02d598fe-47e6-4a5f-aee3-a0d0738f1e79 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:24:35.286727 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-02d598fe-47e6-4a5f-aee3-a0d0738f1e79 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:35.287222 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-02d598fe-47e6-4a5f-aee3-a0d0738f1e79 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:35.288006 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-02d598fe-47e6-4a5f-aee3-a0d0738f1e79 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:35.288457 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-02d598fe-47e6-4a5f-aee3-a0d0738f1e79 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:35.461220 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-02d598fe-47e6-4a5f-aee3-a0d0738f1e79 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:35.468879 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-02d598fe-47e6-4a5f-aee3-a0d0738f1e79 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:35.470357 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-02d598fe-47e6-4a5f-aee3-a0d0738f1e79 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:35.471532 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-02d598fe-47e6-4a5f-aee3-a0d0738f1e79 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f" status: 200 len: 1730 microversion: 2.20 time: 0.195911 Dec 14 03:24:35.472078 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 582/1189] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:24:35 2021] GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f => generated 1730 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:24:36.490959 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-6a52714a-5321-421e-97af-143775ac1b7b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:24:36.491522 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-6a52714a-5321-421e-97af-143775ac1b7b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:24:36.497728 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6a52714a-5321-421e-97af-143775ac1b7b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:36.498174 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6a52714a-5321-421e-97af-143775ac1b7b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:36.498934 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6a52714a-5321-421e-97af-143775ac1b7b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:36.499387 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6a52714a-5321-421e-97af-143775ac1b7b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:36.627972 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-6a52714a-5321-421e-97af-143775ac1b7b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:36.635590 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-6a52714a-5321-421e-97af-143775ac1b7b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:36.637068 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-6a52714a-5321-421e-97af-143775ac1b7b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:36.638202 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-6a52714a-5321-421e-97af-143775ac1b7b tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f" status: 200 len: 1730 microversion: 2.20 time: 0.151797 Dec 14 03:24:36.638757 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 608/1190] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:24:36 2021] GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:24:36.823307 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-d693f918-4b4b-4552-a5e0-6d96551980bd tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:24:36.824274 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-d693f918-4b4b-4552-a5e0-6d96551980bd tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:24:36.830412 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-d693f918-4b4b-4552-a5e0-6d96551980bd tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:36.830867 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-d693f918-4b4b-4552-a5e0-6d96551980bd tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:36.831680 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-d693f918-4b4b-4552-a5e0-6d96551980bd tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:36.832119 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-d693f918-4b4b-4552-a5e0-6d96551980bd tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:36.860507 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-d693f918-4b4b-4552-a5e0-6d96551980bd tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040907 Dec 14 03:24:36.861049 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 583/1191] 10.222.0.43 () {58 vars in 1301 bytes} [Tue Dec 14 03:24:36 2021] GET /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:24:36.871466 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-78bdd839-8e8e-4661-8a53-7657b637a920 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:24:36.871969 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-78bdd839-8e8e-4661-8a53-7657b637a920 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:24:36.877717 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-78bdd839-8e8e-4661-8a53-7657b637a920 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:36.878175 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-78bdd839-8e8e-4661-8a53-7657b637a920 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:36.878953 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-78bdd839-8e8e-4661-8a53-7657b637a920 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:36.879425 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-78bdd839-8e8e-4661-8a53-7657b637a920 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:36.906527 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-78bdd839-8e8e-4661-8a53-7657b637a920 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/os-volume_attachments/0861217c-fbd5-4c03-82a6-e3f3a2887a82" status: 200 len: 194 microversion: 2.1 time: 0.038784 Dec 14 03:24:36.907105 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 609/1192] 10.222.0.43 () {58 vars in 1412 bytes} [Tue Dec 14 03:24:36 2021] GET /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/os-volume_attachments/0861217c-fbd5-4c03-82a6-e3f3a2887a82 => generated 194 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:24:37.656558 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-f5a96622-cc66-4ecc-b2f6-27c51f10dfe3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:24:37.657113 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-f5a96622-cc66-4ecc-b2f6-27c51f10dfe3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:24:37.663231 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-f5a96622-cc66-4ecc-b2f6-27c51f10dfe3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:37.663685 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-f5a96622-cc66-4ecc-b2f6-27c51f10dfe3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:37.664472 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-f5a96622-cc66-4ecc-b2f6-27c51f10dfe3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:37.664902 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-f5a96622-cc66-4ecc-b2f6-27c51f10dfe3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:37.790553 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-f5a96622-cc66-4ecc-b2f6-27c51f10dfe3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:37.798326 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-f5a96622-cc66-4ecc-b2f6-27c51f10dfe3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:37.799864 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-f5a96622-cc66-4ecc-b2f6-27c51f10dfe3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:37.801020 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-f5a96622-cc66-4ecc-b2f6-27c51f10dfe3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f" status: 200 len: 1730 microversion: 2.20 time: 0.148300 Dec 14 03:24:37.801579 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 584/1193] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:24:37 2021] GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f => generated 1730 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:24:38.365857 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-b63de068-3982-4b6a-a061-ab3ad29e011f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bbac6231-2ec6-4a5c-a82c-6e8cc2ee1940"}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:24:38.367021 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-b63de068-3982-4b6a-a061-ab3ad29e011f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:24:38.373347 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b63de068-3982-4b6a-a061-ab3ad29e011f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:38.373798 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b63de068-3982-4b6a-a061-ab3ad29e011f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:38.374585 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b63de068-3982-4b6a-a061-ab3ad29e011f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:38.375024 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b63de068-3982-4b6a-a061-ab3ad29e011f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:38.615504 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-b63de068-3982-4b6a-a061-ab3ad29e011f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.254124 Dec 14 03:24:38.616111 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 610/1194] 10.222.0.43 () {60 vars in 1322 bytes} [Tue Dec 14 03:24:38 2021] POST /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/os-volume_attachments => generated 194 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:24:38.819636 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-e05afa45-9882-437e-abeb-279c87d0109f tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:24:38.820247 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-e05afa45-9882-437e-abeb-279c87d0109f tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:24:38.826522 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-e05afa45-9882-437e-abeb-279c87d0109f tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:38.826989 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-e05afa45-9882-437e-abeb-279c87d0109f tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:38.827803 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-e05afa45-9882-437e-abeb-279c87d0109f tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:38.828239 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-e05afa45-9882-437e-abeb-279c87d0109f tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:38.962070 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-e05afa45-9882-437e-abeb-279c87d0109f tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:38.970085 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-e05afa45-9882-437e-abeb-279c87d0109f tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:38.971605 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-e05afa45-9882-437e-abeb-279c87d0109f tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:38.972751 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-e05afa45-9882-437e-abeb-279c87d0109f tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f" status: 200 len: 1730 microversion: 2.20 time: 0.157414 Dec 14 03:24:38.975137 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 585/1195] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:24:38 2021] GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:24:39.992847 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-a9c0d8f7-fc06-410c-9c04-a732caedb114 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:24:39.993461 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-a9c0d8f7-fc06-410c-9c04-a732caedb114 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:24:39.999968 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a9c0d8f7-fc06-410c-9c04-a732caedb114 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:40.000414 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a9c0d8f7-fc06-410c-9c04-a732caedb114 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:40.001193 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a9c0d8f7-fc06-410c-9c04-a732caedb114 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:40.001622 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a9c0d8f7-fc06-410c-9c04-a732caedb114 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:40.129566 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-a9c0d8f7-fc06-410c-9c04-a732caedb114 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:40.137744 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-a9c0d8f7-fc06-410c-9c04-a732caedb114 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:40.139255 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-a9c0d8f7-fc06-410c-9c04-a732caedb114 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:40.140397 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-a9c0d8f7-fc06-410c-9c04-a732caedb114 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f" status: 200 len: 1730 microversion: 2.20 time: 0.152567 Dec 14 03:24:40.140959 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 611/1196] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:24:39 2021] GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 14 03:24:41.158306 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-3debc595-fdfd-4e03-8655-d13ed0b7a3e3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:24:41.158924 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-3debc595-fdfd-4e03-8655-d13ed0b7a3e3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:24:41.165250 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-3debc595-fdfd-4e03-8655-d13ed0b7a3e3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:41.165700 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-3debc595-fdfd-4e03-8655-d13ed0b7a3e3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:41.166478 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-3debc595-fdfd-4e03-8655-d13ed0b7a3e3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:41.166918 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-3debc595-fdfd-4e03-8655-d13ed0b7a3e3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:41.293542 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-3debc595-fdfd-4e03-8655-d13ed0b7a3e3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:41.301942 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-3debc595-fdfd-4e03-8655-d13ed0b7a3e3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:41.304360 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-3debc595-fdfd-4e03-8655-d13ed0b7a3e3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:41.305537 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-3debc595-fdfd-4e03-8655-d13ed0b7a3e3 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f" status: 200 len: 1730 microversion: 2.20 time: 0.150972 Dec 14 03:24:41.306100 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 586/1197] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:24:41 2021] GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:24:41.435182 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [req-08a9002b-5fa4-4d90-b138-4ea0e57fcc8b req-7f464275-64f4-4158-abc6-4babd8ab793f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "279d5888-562c-4c6a-b27c-3f8e84fd510f", "name": "network-vif-plugged", "status": "completed", "tag": "9eee83b0-b14c-403e-a6bd-7d2515f7e214"}]} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:24:41.436767 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:24:41.436767 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: warnings.warn(msg) Dec 14 03:24:41.444374 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-08a9002b-5fa4-4d90-b138-4ea0e57fcc8b req-7f464275-64f4-4158-abc6-4babd8ab793f service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:41.444825 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-08a9002b-5fa4-4d90-b138-4ea0e57fcc8b req-7f464275-64f4-4158-abc6-4babd8ab793f service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:41.455735 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.compute.server_external_events [req-08a9002b-5fa4-4d90-b138-4ea0e57fcc8b req-7f464275-64f4-4158-abc6-4babd8ab793f service nova] Creating event network-vif-plugged:9eee83b0-b14c-403e-a6bd-7d2515f7e214 for instance 279d5888-562c-4c6a-b27c-3f8e84fd510f on hv-cinder-81803 Dec 14 03:24:41.460963 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [req-08a9002b-5fa4-4d90-b138-4ea0e57fcc8b req-7f464275-64f4-4158-abc6-4babd8ab793f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029467 Dec 14 03:24:41.461543 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 612/1198] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Dec 14 03:24:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:24:42.323737 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-5026772d-8ada-4700-9a65-7c6300a0d117 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:24:42.324347 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-5026772d-8ada-4700-9a65-7c6300a0d117 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:24:42.330627 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-5026772d-8ada-4700-9a65-7c6300a0d117 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:42.331100 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-5026772d-8ada-4700-9a65-7c6300a0d117 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:42.331880 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-5026772d-8ada-4700-9a65-7c6300a0d117 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:42.332319 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-5026772d-8ada-4700-9a65-7c6300a0d117 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:42.462521 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-5026772d-8ada-4700-9a65-7c6300a0d117 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:42.470164 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-5026772d-8ada-4700-9a65-7c6300a0d117 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:42.471672 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-5026772d-8ada-4700-9a65-7c6300a0d117 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:42.472817 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-5026772d-8ada-4700-9a65-7c6300a0d117 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f" status: 200 len: 1730 microversion: 2.20 time: 0.152827 Dec 14 03:24:42.473366 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 587/1199] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:24:42 2021] GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:24:43.493722 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-2b76246a-ab1e-4af5-86a0-943cd20703ba tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:24:43.494419 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-2b76246a-ab1e-4af5-86a0-943cd20703ba tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:24:43.500872 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2b76246a-ab1e-4af5-86a0-943cd20703ba tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:43.501317 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2b76246a-ab1e-4af5-86a0-943cd20703ba tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:43.502273 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2b76246a-ab1e-4af5-86a0-943cd20703ba tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:43.502705 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2b76246a-ab1e-4af5-86a0-943cd20703ba tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:43.636388 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-2b76246a-ab1e-4af5-86a0-943cd20703ba tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:43.644335 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-2b76246a-ab1e-4af5-86a0-943cd20703ba tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:43.645898 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-2b76246a-ab1e-4af5-86a0-943cd20703ba tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:43.647243 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-2b76246a-ab1e-4af5-86a0-943cd20703ba tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f" status: 200 len: 1730 microversion: 2.20 time: 0.158864 Dec 14 03:24:43.647805 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 613/1200] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:24:43 2021] GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:24:44.665445 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-2154de7d-6dba-4165-b976-8a17e30bcb98 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:24:44.666063 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-2154de7d-6dba-4165-b976-8a17e30bcb98 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:24:44.677845 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-2154de7d-6dba-4165-b976-8a17e30bcb98 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:44.677845 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-2154de7d-6dba-4165-b976-8a17e30bcb98 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:44.677845 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-2154de7d-6dba-4165-b976-8a17e30bcb98 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:44.677845 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-2154de7d-6dba-4165-b976-8a17e30bcb98 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:44.803502 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-2154de7d-6dba-4165-b976-8a17e30bcb98 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:44.811278 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-2154de7d-6dba-4165-b976-8a17e30bcb98 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:44.812772 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-2154de7d-6dba-4165-b976-8a17e30bcb98 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:44.813919 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-2154de7d-6dba-4165-b976-8a17e30bcb98 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f" status: 200 len: 1717 microversion: 2.20 time: 0.152178 Dec 14 03:24:44.814474 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 588/1201] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:24:44 2021] GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f => generated 1717 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:24:46.080650 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-eda0a340-fd9e-4cdf-884c-5a216b81f999 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:24:46.081565 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-eda0a340-fd9e-4cdf-884c-5a216b81f999 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:24:46.087803 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-eda0a340-fd9e-4cdf-884c-5a216b81f999 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:46.088247 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-eda0a340-fd9e-4cdf-884c-5a216b81f999 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:46.089013 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-eda0a340-fd9e-4cdf-884c-5a216b81f999 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:46.089442 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-eda0a340-fd9e-4cdf-884c-5a216b81f999 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:46.118740 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-eda0a340-fd9e-4cdf-884c-5a216b81f999 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041781 Dec 14 03:24:46.119324 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 614/1202] 10.222.0.43 () {58 vars in 1301 bytes} [Tue Dec 14 03:24:46 2021] GET /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:24:46.371570 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-5f86f28c-1202-4788-a71c-7bf23c184489 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:24:46.372157 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-5f86f28c-1202-4788-a71c-7bf23c184489 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:24:46.378411 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-5f86f28c-1202-4788-a71c-7bf23c184489 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:46.378863 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-5f86f28c-1202-4788-a71c-7bf23c184489 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:46.379679 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-5f86f28c-1202-4788-a71c-7bf23c184489 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:46.380122 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-5f86f28c-1202-4788-a71c-7bf23c184489 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:46.410452 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-5f86f28c-1202-4788-a71c-7bf23c184489 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/os-volume_attachments/0861217c-fbd5-4c03-82a6-e3f3a2887a82" status: 200 len: 194 microversion: 2.1 time: 0.042722 Dec 14 03:24:46.411876 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 589/1203] 10.222.0.43 () {58 vars in 1412 bytes} [Tue Dec 14 03:24:46 2021] GET /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/os-volume_attachments/0861217c-fbd5-4c03-82a6-e3f3a2887a82 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:24:46.420301 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-b4857b7b-a23c-49af-848b-70d0e3d354b6 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:24:46.420806 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-b4857b7b-a23c-49af-848b-70d0e3d354b6 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:24:46.426635 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b4857b7b-a23c-49af-848b-70d0e3d354b6 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:46.427133 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b4857b7b-a23c-49af-848b-70d0e3d354b6 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:46.427921 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b4857b7b-a23c-49af-848b-70d0e3d354b6 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:46.428365 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b4857b7b-a23c-49af-848b-70d0e3d354b6 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:46.506489 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.objects.instance [None req-b4857b7b-a23c-49af-848b-70d0e3d354b6 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lazy-loading 'services' on Instance uuid f227308f-4d44-4197-9dfd-ddf690c0c0f9 {{(pid=116072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 14 03:24:46.577415 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-b4857b7b-a23c-49af-848b-70d0e3d354b6 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "DELETE /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/os-volume_attachments/0861217c-fbd5-4c03-82a6-e3f3a2887a82" status: 202 len: 0 microversion: 2.1 time: 0.160594 Dec 14 03:24:46.578000 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 615/1204] 10.222.0.43 () {58 vars in 1415 bytes} [Tue Dec 14 03:24:46 2021] DELETE /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/os-volume_attachments/0861217c-fbd5-4c03-82a6-e3f3a2887a82 => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:24:48.734657 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-ef8badd2-2c63-4558-bccd-92c2cdd74292 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:24:48.735173 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-ef8badd2-2c63-4558-bccd-92c2cdd74292 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:24:48.741735 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ef8badd2-2c63-4558-bccd-92c2cdd74292 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:48.742196 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ef8badd2-2c63-4558-bccd-92c2cdd74292 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:48.742979 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ef8badd2-2c63-4558-bccd-92c2cdd74292 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:48.743468 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ef8badd2-2c63-4558-bccd-92c2cdd74292 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:48.773587 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-ef8badd2-2c63-4558-bccd-92c2cdd74292 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/os-volume_attachments/bbac6231-2ec6-4a5c-a82c-6e8cc2ee1940" status: 200 len: 194 microversion: 2.1 time: 0.042133 Dec 14 03:24:48.774159 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 590/1205] 10.222.0.43 () {58 vars in 1412 bytes} [Tue Dec 14 03:24:48 2021] GET /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/os-volume_attachments/bbac6231-2ec6-4a5c-a82c-6e8cc2ee1940 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:24:48.784031 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-5a4cafbd-df15-4f47-bc50-d45c006fda2f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:24:48.784740 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-5a4cafbd-df15-4f47-bc50-d45c006fda2f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:24:48.791196 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5a4cafbd-df15-4f47-bc50-d45c006fda2f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:48.791647 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5a4cafbd-df15-4f47-bc50-d45c006fda2f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:48.792418 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5a4cafbd-df15-4f47-bc50-d45c006fda2f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:48.792853 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5a4cafbd-df15-4f47-bc50-d45c006fda2f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:48.867391 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.objects.instance [None req-5a4cafbd-df15-4f47-bc50-d45c006fda2f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lazy-loading 'services' on Instance uuid f227308f-4d44-4197-9dfd-ddf690c0c0f9 {{(pid=116072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 14 03:24:48.933283 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-5a4cafbd-df15-4f47-bc50-d45c006fda2f tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "DELETE /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/os-volume_attachments/bbac6231-2ec6-4a5c-a82c-6e8cc2ee1940" status: 202 len: 0 microversion: 2.1 time: 0.153170 Dec 14 03:24:48.933890 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 616/1206] 10.222.0.43 () {58 vars in 1415 bytes} [Tue Dec 14 03:24:48 2021] DELETE /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/os-volume_attachments/bbac6231-2ec6-4a5c-a82c-6e8cc2ee1940 => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:24:49.708502 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 14 03:24:49.708685 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: Tue Dec 14 03:24:49 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 14 03:24:50.084562 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-5284166d-1a36-4ad7-b19d-583010ec8eb0 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:24:50.085588 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-5284166d-1a36-4ad7-b19d-583010ec8eb0 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:24:50.091882 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-5284166d-1a36-4ad7-b19d-583010ec8eb0 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:50.092343 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-5284166d-1a36-4ad7-b19d-583010ec8eb0 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:50.093135 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-5284166d-1a36-4ad7-b19d-583010ec8eb0 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:50.093580 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-5284166d-1a36-4ad7-b19d-583010ec8eb0 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:50.122752 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-5284166d-1a36-4ad7-b19d-583010ec8eb0 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041913 Dec 14 03:24:50.123439 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 591/1207] 10.222.0.43 () {58 vars in 1301 bytes} [Tue Dec 14 03:24:50 2021] GET /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 14 03:24:50.220100 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-f89e0dc9-0026-49cc-8793-fa6f4262292d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:24:50.221189 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-f89e0dc9-0026-49cc-8793-fa6f4262292d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:24:50.227683 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f89e0dc9-0026-49cc-8793-fa6f4262292d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:50.228141 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f89e0dc9-0026-49cc-8793-fa6f4262292d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:50.228923 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f89e0dc9-0026-49cc-8793-fa6f4262292d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:50.229362 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f89e0dc9-0026-49cc-8793-fa6f4262292d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:50.257672 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-f89e0dc9-0026-49cc-8793-fa6f4262292d tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042043 Dec 14 03:24:50.258135 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 617/1208] 10.222.0.43 () {58 vars in 1301 bytes} [Tue Dec 14 03:24:50 2021] GET /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 14 03:24:50.310719 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-6340328d-67c2-4b85-8a78-030f50083911 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:24:50.311240 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-6340328d-67c2-4b85-8a78-030f50083911 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:24:50.316900 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-6340328d-67c2-4b85-8a78-030f50083911 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:50.317349 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-6340328d-67c2-4b85-8a78-030f50083911 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:50.318119 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-6340328d-67c2-4b85-8a78-030f50083911 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:50.318556 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-6340328d-67c2-4b85-8a78-030f50083911 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:50.341820 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-6340328d-67c2-4b85-8a78-030f50083911 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Going to try to terminate instance {{(pid=116071) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 14 03:24:50.415358 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-6340328d-67c2-4b85-8a78-030f50083911 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "DELETE /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9" status: 204 len: 0 microversion: 2.1 time: 0.107972 Dec 14 03:24:50.415940 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 592/1209] 10.222.0.43 () {58 vars in 1238 bytes} [Tue Dec 14 03:24:50 2021] DELETE /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 14 03:24:50.423954 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-3c9fa74f-3799-4eb5-93c9-4533ddaef921 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:24:50.424572 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-3c9fa74f-3799-4eb5-93c9-4533ddaef921 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:24:50.430352 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3c9fa74f-3799-4eb5-93c9-4533ddaef921 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:50.430808 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3c9fa74f-3799-4eb5-93c9-4533ddaef921 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:50.431613 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3c9fa74f-3799-4eb5-93c9-4533ddaef921 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:50.432055 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3c9fa74f-3799-4eb5-93c9-4533ddaef921 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:50.558330 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-3c9fa74f-3799-4eb5-93c9-4533ddaef921 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107444106cda461dab7c403665d92613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:50.566551 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-3c9fa74f-3799-4eb5-93c9-4533ddaef921 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9" status: 200 len: 1672 microversion: 2.1 time: 0.146345 Dec 14 03:24:50.567139 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 618/1210] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:24:50 2021] GET /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9 => generated 1672 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:24:51.583475 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-49f1f33b-06eb-4ec8-8d97-cae970f8f2b9 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:24:51.584173 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-49f1f33b-06eb-4ec8-8d97-cae970f8f2b9 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:24:51.590944 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-49f1f33b-06eb-4ec8-8d97-cae970f8f2b9 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:51.591419 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-49f1f33b-06eb-4ec8-8d97-cae970f8f2b9 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:51.592191 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-49f1f33b-06eb-4ec8-8d97-cae970f8f2b9 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:51.592625 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-49f1f33b-06eb-4ec8-8d97-cae970f8f2b9 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:51.723371 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-49f1f33b-06eb-4ec8-8d97-cae970f8f2b9 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107444106cda461dab7c403665d92613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:51.730600 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-49f1f33b-06eb-4ec8-8d97-cae970f8f2b9 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9" status: 200 len: 1672 microversion: 2.1 time: 0.151169 Dec 14 03:24:51.731225 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 593/1211] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:24:51 2021] GET /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9 => generated 1672 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 03:24:52.747862 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-477577c1-3238-435f-a5e9-18c869d973f5 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:24:52.748686 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-477577c1-3238-435f-a5e9-18c869d973f5 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:24:52.755247 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-477577c1-3238-435f-a5e9-18c869d973f5 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:52.755740 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-477577c1-3238-435f-a5e9-18c869d973f5 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:52.756705 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-477577c1-3238-435f-a5e9-18c869d973f5 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:52.757160 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-477577c1-3238-435f-a5e9-18c869d973f5 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:52.886999 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-477577c1-3238-435f-a5e9-18c869d973f5 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107444106cda461dab7c403665d92613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:52.894389 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-477577c1-3238-435f-a5e9-18c869d973f5 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9" status: 200 len: 1672 microversion: 2.1 time: 0.150327 Dec 14 03:24:52.894958 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 619/1212] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:24:52 2021] GET /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9 => generated 1672 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:24:53.418668 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [req-06666e17-21c9-43e2-bbc9-b625d7af6f28 req-a9ec3ae8-36fd-4424-a8b8-e64e45d8c44d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f227308f-4d44-4197-9dfd-ddf690c0c0f9", "name": "network-vif-deleted", "tag": "cf2ca0eb-9e28-4a89-8062-525c1792d08a"}]} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:24:53.420678 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:24:53.420678 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: warnings.warn(msg) Dec 14 03:24:53.429790 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [req-06666e17-21c9-43e2-bbc9-b625d7af6f28 req-a9ec3ae8-36fd-4424-a8b8-e64e45d8c44d service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:53.430238 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [req-06666e17-21c9-43e2-bbc9-b625d7af6f28 req-a9ec3ae8-36fd-4424-a8b8-e64e45d8c44d service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:53.442084 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.compute.server_external_events [req-06666e17-21c9-43e2-bbc9-b625d7af6f28 req-a9ec3ae8-36fd-4424-a8b8-e64e45d8c44d service nova] Creating event network-vif-deleted:cf2ca0eb-9e28-4a89-8062-525c1792d08a for instance f227308f-4d44-4197-9dfd-ddf690c0c0f9 on hv-cinder-81803 Dec 14 03:24:53.448359 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [req-06666e17-21c9-43e2-bbc9-b625d7af6f28 req-a9ec3ae8-36fd-4424-a8b8-e64e45d8c44d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032902 Dec 14 03:24:53.449111 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 594/1213] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Dec 14 03:24:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:24:53.911946 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-ab13e0fb-7af5-41a6-ab19-42c61513e098 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:24:53.912517 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-ab13e0fb-7af5-41a6-ab19-42c61513e098 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:24:53.918812 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ab13e0fb-7af5-41a6-ab19-42c61513e098 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:53.919303 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ab13e0fb-7af5-41a6-ab19-42c61513e098 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:53.920100 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ab13e0fb-7af5-41a6-ab19-42c61513e098 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:53.920543 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ab13e0fb-7af5-41a6-ab19-42c61513e098 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:53.962522 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ab13e0fb-7af5-41a6-ab19-42c61513e098 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:53.963424 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ab13e0fb-7af5-41a6-ab19-42c61513e098 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:53.964075 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.objects.instance [None req-ab13e0fb-7af5-41a6-ab19-42c61513e098 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lazy-loading 'fault' on Instance uuid f227308f-4d44-4197-9dfd-ddf690c0c0f9 {{(pid=116072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 14 03:24:54.004324 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-ab13e0fb-7af5-41a6-ab19-42c61513e098 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107444106cda461dab7c403665d92613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11634c00674445cb81d9dabfbcc791a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:24:54.019409 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-ab13e0fb-7af5-41a6-ab19-42c61513e098 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9" status: 200 len: 1327 microversion: 2.1 time: 0.111280 Dec 14 03:24:54.020553 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 620/1214] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:24:53 2021] GET /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9 => generated 1327 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:24:55.037899 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-6c5c9159-a7dc-4985-b4aa-f9b9a654936b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:24:55.039235 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-6c5c9159-a7dc-4985-b4aa-f9b9a654936b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:24:55.045704 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-6c5c9159-a7dc-4985-b4aa-f9b9a654936b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:55.046153 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-6c5c9159-a7dc-4985-b4aa-f9b9a654936b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:55.046932 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-6c5c9159-a7dc-4985-b4aa-f9b9a654936b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:55.047400 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-6c5c9159-a7dc-4985-b4aa-f9b9a654936b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:55.060024 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.wsgi [None req-6c5c9159-a7dc-4985-b4aa-f9b9a654936b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] HTTP exception thrown: Instance f227308f-4d44-4197-9dfd-ddf690c0c0f9 could not be found. Dec 14 03:24:55.060613 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-6c5c9159-a7dc-4985-b4aa-f9b9a654936b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Returning 404 to user: Instance f227308f-4d44-4197-9dfd-ddf690c0c0f9 could not be found. {{(pid=116071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 03:24:55.061422 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-6c5c9159-a7dc-4985-b4aa-f9b9a654936b tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9" status: 404 len: 111 microversion: 2.1 time: 0.027597 Dec 14 03:24:55.061936 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 595/1215] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:24:55 2021] GET /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 14 03:24:55.070057 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-5d756d91-dcd4-421e-8562-a2947a6b56a9 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '.version_select at 0x7fa503777670>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:24:55.087577 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-5d756d91-dcd4-421e-8562-a2947a6b56a9 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2041604421" status: 202 len: 0 microversion: 2.1 time: 0.021091 Dec 14 03:24:55.088128 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 621/1216] 10.222.0.43 () {58 vars in 1220 bytes} [Tue Dec 14 03:24:55 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2041604421 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:24:57.950492 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-a221d342-5857-46ee-8cf5-cb07d262a215 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:24:57.951021 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-a221d342-5857-46ee-8cf5-cb07d262a215 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:24:57.956773 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a221d342-5857-46ee-8cf5-cb07d262a215 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:57.957221 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a221d342-5857-46ee-8cf5-cb07d262a215 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:57.958010 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a221d342-5857-46ee-8cf5-cb07d262a215 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:57.958447 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a221d342-5857-46ee-8cf5-cb07d262a215 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:57.971292 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.wsgi [None req-a221d342-5857-46ee-8cf5-cb07d262a215 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] HTTP exception thrown: Instance f227308f-4d44-4197-9dfd-ddf690c0c0f9 could not be found. Dec 14 03:24:57.971866 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-a221d342-5857-46ee-8cf5-cb07d262a215 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Returning 404 to user: Instance f227308f-4d44-4197-9dfd-ddf690c0c0f9 could not be found. {{(pid=116071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 03:24:57.972660 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-a221d342-5857-46ee-8cf5-cb07d262a215 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "DELETE /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9" status: 404 len: 111 microversion: 2.1 time: 0.026031 Dec 14 03:24:57.973165 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 596/1217] 10.222.0.43 () {58 vars in 1238 bytes} [Tue Dec 14 03:24:57 2021] DELETE /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 14 03:24:57.981144 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-7bb9c644-ea6b-4d19-9bf8-00886e64449c tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:24:57.981755 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-7bb9c644-ea6b-4d19-9bf8-00886e64449c tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: f227308f-4d44-4197-9dfd-ddf690c0c0f9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:24:57.988558 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7bb9c644-ea6b-4d19-9bf8-00886e64449c tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:57.989003 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7bb9c644-ea6b-4d19-9bf8-00886e64449c tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:57.989769 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7bb9c644-ea6b-4d19-9bf8-00886e64449c tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:57.990199 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7bb9c644-ea6b-4d19-9bf8-00886e64449c tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:58.003167 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.wsgi [None req-7bb9c644-ea6b-4d19-9bf8-00886e64449c tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] HTTP exception thrown: Instance f227308f-4d44-4197-9dfd-ddf690c0c0f9 could not be found. Dec 14 03:24:58.003741 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-7bb9c644-ea6b-4d19-9bf8-00886e64449c tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Returning 404 to user: Instance f227308f-4d44-4197-9dfd-ddf690c0c0f9 could not be found. {{(pid=116072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 03:24:58.004640 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-7bb9c644-ea6b-4d19-9bf8-00886e64449c tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9" status: 404 len: 111 microversion: 2.1 time: 0.027555 Dec 14 03:24:58.005170 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 622/1218] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:24:57 2021] GET /compute/v2.1/servers/f227308f-4d44-4197-9dfd-ddf690c0c0f9 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 14 03:24:59.127530 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-c619e092-7086-4974-92e7-cf211e5432d2 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:24:59.128020 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-c619e092-7086-4974-92e7-cf211e5432d2 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:24:59.135136 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c619e092-7086-4974-92e7-cf211e5432d2 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:59.135588 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c619e092-7086-4974-92e7-cf211e5432d2 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:59.136355 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c619e092-7086-4974-92e7-cf211e5432d2 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:59.136790 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c619e092-7086-4974-92e7-cf211e5432d2 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:59.150163 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.wsgi [None req-c619e092-7086-4974-92e7-cf211e5432d2 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] HTTP exception thrown: Instance fd35b83c-0304-43fc-85ec-731c395d3364 could not be found. Dec 14 03:24:59.150733 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-c619e092-7086-4974-92e7-cf211e5432d2 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Returning 404 to user: Instance fd35b83c-0304-43fc-85ec-731c395d3364 could not be found. {{(pid=116071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 03:24:59.151555 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-c619e092-7086-4974-92e7-cf211e5432d2 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "DELETE /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364" status: 404 len: 111 microversion: 2.1 time: 0.027715 Dec 14 03:24:59.152058 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 597/1219] 10.222.0.43 () {58 vars in 1238 bytes} [Tue Dec 14 03:24:59 2021] DELETE /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 14 03:24:59.159680 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-a646aefc-4e19-4441-9b75-929eedd53194 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:24:59.160290 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-a646aefc-4e19-4441-9b75-929eedd53194 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] [instance: fd35b83c-0304-43fc-85ec-731c395d3364] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:24:59.166389 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a646aefc-4e19-4441-9b75-929eedd53194 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:59.166837 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a646aefc-4e19-4441-9b75-929eedd53194 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:59.167634 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a646aefc-4e19-4441-9b75-929eedd53194 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:24:59.168067 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a646aefc-4e19-4441-9b75-929eedd53194 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:24:59.180535 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.wsgi [None req-a646aefc-4e19-4441-9b75-929eedd53194 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] HTTP exception thrown: Instance fd35b83c-0304-43fc-85ec-731c395d3364 could not be found. Dec 14 03:24:59.181108 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-a646aefc-4e19-4441-9b75-929eedd53194 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] Returning 404 to user: Instance fd35b83c-0304-43fc-85ec-731c395d3364 could not be found. {{(pid=116072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 03:24:59.181898 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-a646aefc-4e19-4441-9b75-929eedd53194 tempest-AttachVolumeTestJSON-1846638734 tempest-AttachVolumeTestJSON-1846638734-project] 10.222.0.43 "GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364" status: 404 len: 111 microversion: 2.1 time: 0.025866 Dec 14 03:24:59.182401 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 623/1220] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:24:59 2021] GET /compute/v2.1/servers/fd35b83c-0304-43fc-85ec-731c395d3364 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 14 03:25:52.269292 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-9b41528a-f386-487c-9fc3-95775b24ef91 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:25:52.270232 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-9b41528a-f386-487c-9fc3-95775b24ef91 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:25:52.276308 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-9b41528a-f386-487c-9fc3-95775b24ef91 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:25:52.276758 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-9b41528a-f386-487c-9fc3-95775b24ef91 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:25:52.277538 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-9b41528a-f386-487c-9fc3-95775b24ef91 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:25:52.277977 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-9b41528a-f386-487c-9fc3-95775b24ef91 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:25:52.306676 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-9b41528a-f386-487c-9fc3-95775b24ef91 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041132 Dec 14 03:25:52.307256 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 598/1221] 10.222.0.43 () {60 vars in 1342 bytes} [Tue Dec 14 03:25:52 2021] GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:25:52.359734 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-8dea81c1-5373-4396-b3dd-7a5f24444c36 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:25:52.360220 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-8dea81c1-5373-4396-b3dd-7a5f24444c36 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:25:52.366361 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8dea81c1-5373-4396-b3dd-7a5f24444c36 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:25:52.366804 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8dea81c1-5373-4396-b3dd-7a5f24444c36 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:25:52.368215 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8dea81c1-5373-4396-b3dd-7a5f24444c36 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:25:52.368648 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8dea81c1-5373-4396-b3dd-7a5f24444c36 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:25:52.392199 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-8dea81c1-5373-4396-b3dd-7a5f24444c36 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Going to try to terminate instance {{(pid=116072) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 14 03:25:52.465879 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-8dea81c1-5373-4396-b3dd-7a5f24444c36 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "DELETE /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f" status: 204 len: 0 microversion: 2.20 time: 0.109435 Dec 14 03:25:52.466764 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 624/1222] 10.222.0.43 () {60 vars in 1279 bytes} [Tue Dec 14 03:25:52 2021] DELETE /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 14 03:25:52.475543 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-6dbe3632-4f67-4fa9-bf07-51d0ce50b397 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:25:52.476166 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-6dbe3632-4f67-4fa9-bf07-51d0ce50b397 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:25:52.482595 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-6dbe3632-4f67-4fa9-bf07-51d0ce50b397 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:25:52.483075 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-6dbe3632-4f67-4fa9-bf07-51d0ce50b397 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:25:52.483868 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-6dbe3632-4f67-4fa9-bf07-51d0ce50b397 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:25:52.484316 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-6dbe3632-4f67-4fa9-bf07-51d0ce50b397 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:25:52.612602 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-6dbe3632-4f67-4fa9-bf07-51d0ce50b397 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:25:52.620340 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-6dbe3632-4f67-4fa9-bf07-51d0ce50b397 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:25:52.621838 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-6dbe3632-4f67-4fa9-bf07-51d0ce50b397 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:25:52.622992 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-6dbe3632-4f67-4fa9-bf07-51d0ce50b397 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f" status: 200 len: 1723 microversion: 2.20 time: 0.151987 Dec 14 03:25:52.623579 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 599/1223] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:25:52 2021] GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:25:53.641931 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-a15763f2-bf66-4515-830c-15bf7ebcab14 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:25:53.642666 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-a15763f2-bf66-4515-830c-15bf7ebcab14 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:25:53.649643 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a15763f2-bf66-4515-830c-15bf7ebcab14 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:25:53.650099 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a15763f2-bf66-4515-830c-15bf7ebcab14 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:25:53.650875 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a15763f2-bf66-4515-830c-15bf7ebcab14 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:25:53.651342 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a15763f2-bf66-4515-830c-15bf7ebcab14 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:25:53.778689 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-a15763f2-bf66-4515-830c-15bf7ebcab14 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:25:53.786256 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-a15763f2-bf66-4515-830c-15bf7ebcab14 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:25:53.787773 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-a15763f2-bf66-4515-830c-15bf7ebcab14 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:25:53.788917 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-a15763f2-bf66-4515-830c-15bf7ebcab14 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f" status: 200 len: 1723 microversion: 2.20 time: 0.151083 Dec 14 03:25:53.789458 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 625/1224] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:25:53 2021] GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 03:25:54.807540 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-49b8601e-fd2d-40bc-8521-1cdd2830570d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:25:54.808157 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-49b8601e-fd2d-40bc-8521-1cdd2830570d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:25:54.815358 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-49b8601e-fd2d-40bc-8521-1cdd2830570d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:25:54.815805 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-49b8601e-fd2d-40bc-8521-1cdd2830570d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:25:54.816788 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-49b8601e-fd2d-40bc-8521-1cdd2830570d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:25:54.817227 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-49b8601e-fd2d-40bc-8521-1cdd2830570d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:25:54.880041 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-49b8601e-fd2d-40bc-8521-1cdd2830570d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:25:54.887956 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-49b8601e-fd2d-40bc-8521-1cdd2830570d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:25:54.889446 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-49b8601e-fd2d-40bc-8521-1cdd2830570d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a4d52d1d56e44fe97650262ca2e68df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da53d564588b46b7bd658659f40a6ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:25:54.890630 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-49b8601e-fd2d-40bc-8521-1cdd2830570d tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f" status: 200 len: 1657 microversion: 2.20 time: 0.087459 Dec 14 03:25:54.891420 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 600/1225] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:25:54 2021] GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f => generated 1657 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 14 03:25:55.464671 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [req-11d19987-80b5-4318-9fed-b6d0ffa0201b req-8a8de3f6-d1af-4362-a62d-eed411efff44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "279d5888-562c-4c6a-b27c-3f8e84fd510f", "name": "network-vif-deleted", "tag": "9eee83b0-b14c-403e-a6bd-7d2515f7e214"}]} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:25:55.466216 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:25:55.466216 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: warnings.warn(msg) Dec 14 03:25:55.473040 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-11d19987-80b5-4318-9fed-b6d0ffa0201b req-8a8de3f6-d1af-4362-a62d-eed411efff44 service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:25:55.473485 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-11d19987-80b5-4318-9fed-b6d0ffa0201b req-8a8de3f6-d1af-4362-a62d-eed411efff44 service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:25:55.484629 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.compute.server_external_events [req-11d19987-80b5-4318-9fed-b6d0ffa0201b req-8a8de3f6-d1af-4362-a62d-eed411efff44 service nova] Creating event network-vif-deleted:9eee83b0-b14c-403e-a6bd-7d2515f7e214 for instance 279d5888-562c-4c6a-b27c-3f8e84fd510f on hv-cinder-81803 Dec 14 03:25:55.489675 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [req-11d19987-80b5-4318-9fed-b6d0ffa0201b req-8a8de3f6-d1af-4362-a62d-eed411efff44 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.242876 Dec 14 03:25:55.490259 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 626/1226] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Dec 14 03:25:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:25:55.910547 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-be16ff42-94a1-4a44-a0f4-83b656ee7eb0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:25:55.911216 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-be16ff42-94a1-4a44-a0f4-83b656ee7eb0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:25:55.917589 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-be16ff42-94a1-4a44-a0f4-83b656ee7eb0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:25:55.918038 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-be16ff42-94a1-4a44-a0f4-83b656ee7eb0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:25:55.919192 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-be16ff42-94a1-4a44-a0f4-83b656ee7eb0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:25:55.919633 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-be16ff42-94a1-4a44-a0f4-83b656ee7eb0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:25:55.935527 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.wsgi [None req-be16ff42-94a1-4a44-a0f4-83b656ee7eb0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] HTTP exception thrown: Instance 279d5888-562c-4c6a-b27c-3f8e84fd510f could not be found. Dec 14 03:25:55.936117 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-be16ff42-94a1-4a44-a0f4-83b656ee7eb0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Returning 404 to user: Instance 279d5888-562c-4c6a-b27c-3f8e84fd510f could not be found. {{(pid=116071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 03:25:55.937252 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-be16ff42-94a1-4a44-a0f4-83b656ee7eb0 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f" status: 404 len: 111 microversion: 2.20 time: 0.031329 Dec 14 03:25:55.937793 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 601/1227] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:25:55 2021] GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 14 03:25:55.947084 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-82713944-1a94-42eb-a826-daf202e1ef2e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '.version_select at 0x7fa5082f6280>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:25:55.966661 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-82713944-1a94-42eb-a826-daf202e1ef2e tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2040974441" status: 204 len: 0 microversion: 2.20 time: 0.023967 Dec 14 03:25:55.967657 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 627/1228] 10.222.0.43 () {60 vars in 1261 bytes} [Tue Dec 14 03:25:55 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2040974441 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 14 03:25:57.821496 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-f5dfc228-ba80-45d5-8129-b83f76b26d3a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:25:57.822034 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-f5dfc228-ba80-45d5-8129-b83f76b26d3a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:25:57.828204 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-f5dfc228-ba80-45d5-8129-b83f76b26d3a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:25:57.828665 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-f5dfc228-ba80-45d5-8129-b83f76b26d3a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:25:57.829462 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-f5dfc228-ba80-45d5-8129-b83f76b26d3a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:25:57.829904 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-f5dfc228-ba80-45d5-8129-b83f76b26d3a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:25:57.843636 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.wsgi [None req-f5dfc228-ba80-45d5-8129-b83f76b26d3a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] HTTP exception thrown: Instance 279d5888-562c-4c6a-b27c-3f8e84fd510f could not be found. Dec 14 03:25:57.844233 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-f5dfc228-ba80-45d5-8129-b83f76b26d3a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Returning 404 to user: Instance 279d5888-562c-4c6a-b27c-3f8e84fd510f could not be found. {{(pid=116071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 03:25:57.845125 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-f5dfc228-ba80-45d5-8129-b83f76b26d3a tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "DELETE /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f" status: 404 len: 111 microversion: 2.20 time: 0.027915 Dec 14 03:25:57.845722 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 602/1229] 10.222.0.43 () {60 vars in 1279 bytes} [Tue Dec 14 03:25:57 2021] DELETE /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 14 03:25:57.854196 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-1cd22d26-0528-4056-88de-5f49183e8a35 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:25:57.854916 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-1cd22d26-0528-4056-88de-5f49183e8a35 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 279d5888-562c-4c6a-b27c-3f8e84fd510f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:25:57.861008 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1cd22d26-0528-4056-88de-5f49183e8a35 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:25:57.861458 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1cd22d26-0528-4056-88de-5f49183e8a35 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:25:57.862495 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1cd22d26-0528-4056-88de-5f49183e8a35 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:25:57.862935 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1cd22d26-0528-4056-88de-5f49183e8a35 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:25:57.876280 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.wsgi [None req-1cd22d26-0528-4056-88de-5f49183e8a35 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] HTTP exception thrown: Instance 279d5888-562c-4c6a-b27c-3f8e84fd510f could not be found. Dec 14 03:25:57.876864 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-1cd22d26-0528-4056-88de-5f49183e8a35 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Returning 404 to user: Instance 279d5888-562c-4c6a-b27c-3f8e84fd510f could not be found. {{(pid=116072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 03:25:57.877675 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-1cd22d26-0528-4056-88de-5f49183e8a35 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f" status: 404 len: 111 microversion: 2.20 time: 0.027636 Dec 14 03:25:57.878206 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 628/1230] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:25:57 2021] GET /compute/v2.1/servers/279d5888-562c-4c6a-b27c-3f8e84fd510f => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 14 03:25:59.009439 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-32501b26-dd3f-41b6-bcb3-c78a3b3693da tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:25:59.009952 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-32501b26-dd3f-41b6-bcb3-c78a3b3693da tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:25:59.016131 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-32501b26-dd3f-41b6-bcb3-c78a3b3693da tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:25:59.016581 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-32501b26-dd3f-41b6-bcb3-c78a3b3693da tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:25:59.017357 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-32501b26-dd3f-41b6-bcb3-c78a3b3693da tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:25:59.017789 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-32501b26-dd3f-41b6-bcb3-c78a3b3693da tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:25:59.030844 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.wsgi [None req-32501b26-dd3f-41b6-bcb3-c78a3b3693da tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] HTTP exception thrown: Instance 86395107-d320-45d8-83de-f1848858be10 could not be found. Dec 14 03:25:59.031396 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-32501b26-dd3f-41b6-bcb3-c78a3b3693da tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Returning 404 to user: Instance 86395107-d320-45d8-83de-f1848858be10 could not be found. {{(pid=116071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 03:25:59.032208 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-32501b26-dd3f-41b6-bcb3-c78a3b3693da tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "DELETE /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 404 len: 111 microversion: 2.20 time: 0.026850 Dec 14 03:25:59.032848 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 603/1231] 10.222.0.43 () {60 vars in 1279 bytes} [Tue Dec 14 03:25:59 2021] DELETE /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 14 03:25:59.041138 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-f4130909-5207-46d6-9141-5be4f1669cb7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:25:59.041757 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-f4130909-5207-46d6-9141-5be4f1669cb7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] [instance: 86395107-d320-45d8-83de-f1848858be10] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:25:59.048163 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f4130909-5207-46d6-9141-5be4f1669cb7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:25:59.048622 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f4130909-5207-46d6-9141-5be4f1669cb7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:25:59.049412 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f4130909-5207-46d6-9141-5be4f1669cb7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:25:59.049855 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f4130909-5207-46d6-9141-5be4f1669cb7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:25:59.063542 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.wsgi [None req-f4130909-5207-46d6-9141-5be4f1669cb7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] HTTP exception thrown: Instance 86395107-d320-45d8-83de-f1848858be10 could not be found. Dec 14 03:25:59.064144 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-f4130909-5207-46d6-9141-5be4f1669cb7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] Returning 404 to user: Instance 86395107-d320-45d8-83de-f1848858be10 could not be found. {{(pid=116072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 03:25:59.064965 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-f4130909-5207-46d6-9141-5be4f1669cb7 tempest-AttachVolumeShelveTestJSON-1202164640 tempest-AttachVolumeShelveTestJSON-1202164640-project] 10.222.0.43 "GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10" status: 404 len: 111 microversion: 2.20 time: 0.028145 Dec 14 03:25:59.065499 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 629/1232] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Dec 14 03:25:59 2021] GET /compute/v2.1/servers/86395107-d320-45d8-83de-f1848858be10 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 14 03:26:09.845041 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-2a428f4d-4e2d-4eb6-829e-b4316bd96379 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:26:09.846073 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-2a428f4d-4e2d-4eb6-829e-b4316bd96379 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] [instance: 76d36b1d-a395-46b5-b80d-9fa1871c0873] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:26:09.853373 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-2a428f4d-4e2d-4eb6-829e-b4316bd96379 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:09.854044 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-2a428f4d-4e2d-4eb6-829e-b4316bd96379 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:09.854934 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-2a428f4d-4e2d-4eb6-829e-b4316bd96379 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:09.855498 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-2a428f4d-4e2d-4eb6-829e-b4316bd96379 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:09.882545 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-2a428f4d-4e2d-4eb6-829e-b4316bd96379 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] [instance: 76d36b1d-a395-46b5-b80d-9fa1871c0873] Going to try to terminate instance {{(pid=116071) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 14 03:26:09.960787 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-2a428f4d-4e2d-4eb6-829e-b4316bd96379 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "DELETE /compute/v2.1/servers/76d36b1d-a395-46b5-b80d-9fa1871c0873" status: 204 len: 0 microversion: 2.1 time: 0.119214 Dec 14 03:26:09.963222 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 604/1233] 10.222.0.43 () {58 vars in 1238 bytes} [Tue Dec 14 03:26:09 2021] DELETE /compute/v2.1/servers/76d36b1d-a395-46b5-b80d-9fa1871c0873 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 14 03:26:09.971189 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-1b942e53-fd3f-448f-b259-50730bfab9d5 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:26:09.972386 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-1b942e53-fd3f-448f-b259-50730bfab9d5 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] [instance: 76d36b1d-a395-46b5-b80d-9fa1871c0873] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:26:09.980066 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1b942e53-fd3f-448f-b259-50730bfab9d5 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:09.980066 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1b942e53-fd3f-448f-b259-50730bfab9d5 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:09.980509 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1b942e53-fd3f-448f-b259-50730bfab9d5 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:09.980946 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1b942e53-fd3f-448f-b259-50730bfab9d5 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:10.128623 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-1b942e53-fd3f-448f-b259-50730bfab9d5 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf869873369f496e9e25a6d6b2a7ba86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:26:10.136845 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-1b942e53-fd3f-448f-b259-50730bfab9d5 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /compute/v2.1/servers/76d36b1d-a395-46b5-b80d-9fa1871c0873" status: 200 len: 1577 microversion: 2.1 time: 0.169790 Dec 14 03:26:10.137718 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 630/1234] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:26:09 2021] GET /compute/v2.1/servers/76d36b1d-a395-46b5-b80d-9fa1871c0873 => generated 1577 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:26:11.154269 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-b0042388-c90d-464c-b466-3f3b47ef26f5 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:26:11.154980 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-b0042388-c90d-464c-b466-3f3b47ef26f5 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] [instance: 76d36b1d-a395-46b5-b80d-9fa1871c0873] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:26:11.161290 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b0042388-c90d-464c-b466-3f3b47ef26f5 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:11.161747 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b0042388-c90d-464c-b466-3f3b47ef26f5 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:11.162534 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b0042388-c90d-464c-b466-3f3b47ef26f5 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:11.162976 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b0042388-c90d-464c-b466-3f3b47ef26f5 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:11.295876 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-b0042388-c90d-464c-b466-3f3b47ef26f5 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf869873369f496e9e25a6d6b2a7ba86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:26:11.303679 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-b0042388-c90d-464c-b466-3f3b47ef26f5 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /compute/v2.1/servers/76d36b1d-a395-46b5-b80d-9fa1871c0873" status: 200 len: 1577 microversion: 2.1 time: 0.153399 Dec 14 03:26:11.304253 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 605/1235] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:26:11 2021] GET /compute/v2.1/servers/76d36b1d-a395-46b5-b80d-9fa1871c0873 => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:26:12.324083 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-e727ceeb-4ff8-4195-b0eb-fd8968065e39 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:26:12.324824 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-e727ceeb-4ff8-4195-b0eb-fd8968065e39 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] [instance: 76d36b1d-a395-46b5-b80d-9fa1871c0873] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:26:12.330796 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e727ceeb-4ff8-4195-b0eb-fd8968065e39 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:12.331403 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e727ceeb-4ff8-4195-b0eb-fd8968065e39 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:12.332400 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e727ceeb-4ff8-4195-b0eb-fd8968065e39 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:12.333012 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e727ceeb-4ff8-4195-b0eb-fd8968065e39 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:12.410511 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-e727ceeb-4ff8-4195-b0eb-fd8968065e39 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf869873369f496e9e25a6d6b2a7ba86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:26:12.429828 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-e727ceeb-4ff8-4195-b0eb-fd8968065e39 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /compute/v2.1/servers/76d36b1d-a395-46b5-b80d-9fa1871c0873" status: 200 len: 1510 microversion: 2.1 time: 0.109515 Dec 14 03:26:12.430650 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 631/1236] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:26:12 2021] GET /compute/v2.1/servers/76d36b1d-a395-46b5-b80d-9fa1871c0873 => generated 1510 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:26:12.749525 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [req-02e9f61c-0a56-4107-858b-8332487ea418 req-8fd11982-ecd0-421a-8199-6a3a4505b608 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76d36b1d-a395-46b5-b80d-9fa1871c0873", "name": "network-vif-deleted", "tag": "ee1b94f1-9b24-4f43-ae74-a354e91e38f1"}]} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:26:12.752094 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:26:12.752094 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: warnings.warn(msg) Dec 14 03:26:12.760652 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [req-02e9f61c-0a56-4107-858b-8332487ea418 req-8fd11982-ecd0-421a-8199-6a3a4505b608 service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:12.761409 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [req-02e9f61c-0a56-4107-858b-8332487ea418 req-8fd11982-ecd0-421a-8199-6a3a4505b608 service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:12.773071 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.compute.server_external_events [req-02e9f61c-0a56-4107-858b-8332487ea418 req-8fd11982-ecd0-421a-8199-6a3a4505b608 service nova] Creating event network-vif-deleted:ee1b94f1-9b24-4f43-ae74-a354e91e38f1 for instance 76d36b1d-a395-46b5-b80d-9fa1871c0873 on hv-cinder-81803 Dec 14 03:26:12.783994 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [req-02e9f61c-0a56-4107-858b-8332487ea418 req-8fd11982-ecd0-421a-8199-6a3a4505b608 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038233 Dec 14 03:26:12.785154 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 606/1237] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Dec 14 03:26:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:26:13.447192 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-5ff4773a-2951-41ab-8951-241bdeb5ec9c tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:26:13.447816 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-5ff4773a-2951-41ab-8951-241bdeb5ec9c tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] [instance: 76d36b1d-a395-46b5-b80d-9fa1871c0873] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:26:13.458093 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5ff4773a-2951-41ab-8951-241bdeb5ec9c tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:13.459815 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5ff4773a-2951-41ab-8951-241bdeb5ec9c tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:13.460374 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5ff4773a-2951-41ab-8951-241bdeb5ec9c tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:13.461009 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5ff4773a-2951-41ab-8951-241bdeb5ec9c tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:13.527865 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-5ff4773a-2951-41ab-8951-241bdeb5ec9c tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf869873369f496e9e25a6d6b2a7ba86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:26:13.535772 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-5ff4773a-2951-41ab-8951-241bdeb5ec9c tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /compute/v2.1/servers/76d36b1d-a395-46b5-b80d-9fa1871c0873" status: 200 len: 1225 microversion: 2.1 time: 0.092212 Dec 14 03:26:13.536804 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 632/1238] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:26:13 2021] GET /compute/v2.1/servers/76d36b1d-a395-46b5-b80d-9fa1871c0873 => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:26:14.554280 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-9d365f8b-c311-4aaf-8981-61faf855c17f tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:26:14.554948 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-9d365f8b-c311-4aaf-8981-61faf855c17f tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] [instance: 76d36b1d-a395-46b5-b80d-9fa1871c0873] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:26:14.561665 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-9d365f8b-c311-4aaf-8981-61faf855c17f tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:14.562120 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-9d365f8b-c311-4aaf-8981-61faf855c17f tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:14.562899 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-9d365f8b-c311-4aaf-8981-61faf855c17f tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:14.563370 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-9d365f8b-c311-4aaf-8981-61faf855c17f tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:14.621614 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-9d365f8b-c311-4aaf-8981-61faf855c17f tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf869873369f496e9e25a6d6b2a7ba86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:26:14.628861 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-9d365f8b-c311-4aaf-8981-61faf855c17f tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /compute/v2.1/servers/76d36b1d-a395-46b5-b80d-9fa1871c0873" status: 200 len: 1225 microversion: 2.1 time: 0.079151 Dec 14 03:26:14.629416 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 607/1239] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:26:14 2021] GET /compute/v2.1/servers/76d36b1d-a395-46b5-b80d-9fa1871c0873 => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:26:15.645172 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-46637a41-5756-4fab-9bf7-22e5afec7980 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:26:15.645817 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-46637a41-5756-4fab-9bf7-22e5afec7980 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] [instance: 76d36b1d-a395-46b5-b80d-9fa1871c0873] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:26:15.652569 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-46637a41-5756-4fab-9bf7-22e5afec7980 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:15.653018 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-46637a41-5756-4fab-9bf7-22e5afec7980 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:15.653811 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-46637a41-5756-4fab-9bf7-22e5afec7980 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:15.654253 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-46637a41-5756-4fab-9bf7-22e5afec7980 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:15.715912 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-46637a41-5756-4fab-9bf7-22e5afec7980 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf869873369f496e9e25a6d6b2a7ba86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:26:15.723131 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-46637a41-5756-4fab-9bf7-22e5afec7980 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /compute/v2.1/servers/76d36b1d-a395-46b5-b80d-9fa1871c0873" status: 200 len: 1225 microversion: 2.1 time: 0.081568 Dec 14 03:26:15.723689 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 633/1240] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:26:15 2021] GET /compute/v2.1/servers/76d36b1d-a395-46b5-b80d-9fa1871c0873 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:26:16.740215 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-683d23b2-9060-4236-93ec-8e7532863386 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:26:16.740846 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-683d23b2-9060-4236-93ec-8e7532863386 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] [instance: 76d36b1d-a395-46b5-b80d-9fa1871c0873] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:26:16.747763 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-683d23b2-9060-4236-93ec-8e7532863386 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:16.748222 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-683d23b2-9060-4236-93ec-8e7532863386 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:16.749011 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-683d23b2-9060-4236-93ec-8e7532863386 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:16.749459 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-683d23b2-9060-4236-93ec-8e7532863386 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:16.809830 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-683d23b2-9060-4236-93ec-8e7532863386 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf869873369f496e9e25a6d6b2a7ba86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:26:16.817160 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-683d23b2-9060-4236-93ec-8e7532863386 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /compute/v2.1/servers/76d36b1d-a395-46b5-b80d-9fa1871c0873" status: 200 len: 1225 microversion: 2.1 time: 0.080877 Dec 14 03:26:16.817714 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 608/1241] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:26:16 2021] GET /compute/v2.1/servers/76d36b1d-a395-46b5-b80d-9fa1871c0873 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:26:17.833723 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-cb18bbc6-a643-40e0-9bb9-d3571b2f0c18 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:26:17.834415 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-cb18bbc6-a643-40e0-9bb9-d3571b2f0c18 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] [instance: 76d36b1d-a395-46b5-b80d-9fa1871c0873] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:26:17.841079 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-cb18bbc6-a643-40e0-9bb9-d3571b2f0c18 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:17.841530 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-cb18bbc6-a643-40e0-9bb9-d3571b2f0c18 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:17.842336 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-cb18bbc6-a643-40e0-9bb9-d3571b2f0c18 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:17.842834 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-cb18bbc6-a643-40e0-9bb9-d3571b2f0c18 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:17.857046 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.wsgi [None req-cb18bbc6-a643-40e0-9bb9-d3571b2f0c18 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] HTTP exception thrown: Instance 76d36b1d-a395-46b5-b80d-9fa1871c0873 could not be found. Dec 14 03:26:17.857653 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-cb18bbc6-a643-40e0-9bb9-d3571b2f0c18 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Returning 404 to user: Instance 76d36b1d-a395-46b5-b80d-9fa1871c0873 could not be found. {{(pid=116072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 03:26:17.858491 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-cb18bbc6-a643-40e0-9bb9-d3571b2f0c18 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /compute/v2.1/servers/76d36b1d-a395-46b5-b80d-9fa1871c0873" status: 404 len: 111 microversion: 2.1 time: 0.028596 Dec 14 03:26:17.859068 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 634/1242] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:26:17 2021] GET /compute/v2.1/servers/76d36b1d-a395-46b5-b80d-9fa1871c0873 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 14 03:26:17.957229 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-5499fc08-0f25-4026-924c-5309354dad4e tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1544334778", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-801497898", "security_groups": [{"name": "tempest-secgroup-smoke-201763541"}], "block_device_mapping_v2": [{"uuid": "0488d391-782f-4a4f-b546-61da8a4b8f65", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8f2d77d5-e58c-4a97-8899-5e1a2da29f69"}]}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:26:18.066719 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.network.neutron [None req-5499fc08-0f25-4026-924c-5309354dad4e tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] validate_networks() for [('8f2d77d5-e58c-4a97-8899-5e1a2da29f69', None, None, None, None, None)] {{(pid=116071) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 14 03:26:18.435445 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.virt.hardware [None req-5499fc08-0f25-4026-924c-5309354dad4e tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Flavor limits 0:0:0 {{(pid=116071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 14 03:26:18.435898 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.virt.hardware [None req-5499fc08-0f25-4026-924c-5309354dad4e tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Image limits 0:0:0 {{(pid=116071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 14 03:26:18.436373 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.virt.hardware [None req-5499fc08-0f25-4026-924c-5309354dad4e tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Flavor pref 0:0:0 {{(pid=116071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 14 03:26:18.436778 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.virt.hardware [None req-5499fc08-0f25-4026-924c-5309354dad4e tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Image pref 0:0:0 {{(pid=116071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 14 03:26:18.437223 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.virt.hardware [None req-5499fc08-0f25-4026-924c-5309354dad4e tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 14 03:26:18.445956 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-5499fc08-0f25-4026-924c-5309354dad4e tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:18.446407 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-5499fc08-0f25-4026-924c-5309354dad4e tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:18.447264 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-5499fc08-0f25-4026-924c-5309354dad4e tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:18.447708 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-5499fc08-0f25-4026-924c-5309354dad4e tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:18.463510 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.quota [None req-5499fc08-0f25-4026-924c-5309354dad4e tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Getting quotas for project d0c4dcf4957d42b896f04f682afeef7b. Resources: {'cores', 'instances', 'ram'} {{(pid=116071) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 03:26:18.467448 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.quota [None req-5499fc08-0f25-4026-924c-5309354dad4e tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Getting quotas for user bf869873369f496e9e25a6d6b2a7ba86 and project d0c4dcf4957d42b896f04f682afeef7b. Resources: {'cores', 'instances', 'ram'} {{(pid=116071) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 03:26:18.521103 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-5499fc08-0f25-4026-924c-5309354dad4e tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Going to run 1 instances... {{(pid=116071) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 14 03:26:18.523292 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-5499fc08-0f25-4026-924c-5309354dad4e tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] [instance: c2f38df0-5498-4c35-8e93-0221c7e54271] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0488d391-782f-4a4f-b546-61da8a4b8f65',volume_size=None,volume_type=None)] {{(pid=116071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 14 03:26:18.641163 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-5499fc08-0f25-4026-924c-5309354dad4e tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.687833 Dec 14 03:26:18.641796 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 609/1243] 10.222.0.43 () {60 vars in 1146 bytes} [Tue Dec 14 03:26:17 2021] POST /compute/v2.1/servers => generated 405 bytes in 689 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 14 03:26:18.651858 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-e33088d3-68ec-49f5-82e2-e7d61f87d7cf tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:26:18.652610 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-e33088d3-68ec-49f5-82e2-e7d61f87d7cf tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] [instance: c2f38df0-5498-4c35-8e93-0221c7e54271] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:26:18.712006 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-e33088d3-68ec-49f5-82e2-e7d61f87d7cf tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf869873369f496e9e25a6d6b2a7ba86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:26:18.719292 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-e33088d3-68ec-49f5-82e2-e7d61f87d7cf tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /compute/v2.1/servers/c2f38df0-5498-4c35-8e93-0221c7e54271" status: 200 len: 1094 microversion: 2.1 time: 0.071418 Dec 14 03:26:18.719852 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 635/1244] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:26:18 2021] GET /compute/v2.1/servers/c2f38df0-5498-4c35-8e93-0221c7e54271 => generated 1094 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:26:19.740948 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-a867cec3-3ffe-47de-92d4-cc4086a5e1d3 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:26:19.741572 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-a867cec3-3ffe-47de-92d4-cc4086a5e1d3 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] [instance: c2f38df0-5498-4c35-8e93-0221c7e54271] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:26:19.748145 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a867cec3-3ffe-47de-92d4-cc4086a5e1d3 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:19.748833 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a867cec3-3ffe-47de-92d4-cc4086a5e1d3 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:19.749801 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a867cec3-3ffe-47de-92d4-cc4086a5e1d3 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:19.750413 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a867cec3-3ffe-47de-92d4-cc4086a5e1d3 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:19.830809 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-a867cec3-3ffe-47de-92d4-cc4086a5e1d3 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf869873369f496e9e25a6d6b2a7ba86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:26:19.839618 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-a867cec3-3ffe-47de-92d4-cc4086a5e1d3 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /compute/v2.1/servers/c2f38df0-5498-4c35-8e93-0221c7e54271" status: 200 len: 1200 microversion: 2.1 time: 0.103154 Dec 14 03:26:19.840909 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 610/1245] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:26:19 2021] GET /compute/v2.1/servers/c2f38df0-5498-4c35-8e93-0221c7e54271 => generated 1200 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:26:20.859361 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-7d0d45fb-068d-4445-a7cc-876cd21f6d8f tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:26:20.860644 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-7d0d45fb-068d-4445-a7cc-876cd21f6d8f tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] [instance: c2f38df0-5498-4c35-8e93-0221c7e54271] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:26:20.873897 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7d0d45fb-068d-4445-a7cc-876cd21f6d8f tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:20.874389 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7d0d45fb-068d-4445-a7cc-876cd21f6d8f tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:20.875246 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7d0d45fb-068d-4445-a7cc-876cd21f6d8f tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:20.875683 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7d0d45fb-068d-4445-a7cc-876cd21f6d8f tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:21.053412 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-7d0d45fb-068d-4445-a7cc-876cd21f6d8f tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf869873369f496e9e25a6d6b2a7ba86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:26:21.061341 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-7d0d45fb-068d-4445-a7cc-876cd21f6d8f tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /compute/v2.1/servers/c2f38df0-5498-4c35-8e93-0221c7e54271" status: 200 len: 1265 microversion: 2.1 time: 0.207062 Dec 14 03:26:21.061982 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 636/1246] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:26:20 2021] GET /compute/v2.1/servers/c2f38df0-5498-4c35-8e93-0221c7e54271 => generated 1265 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:26:21.378418 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [req-715258bd-f0e7-4713-8303-bd16345f58cd req-1020a324-a603-45d1-9640-e739c86ad5fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2f38df0-5498-4c35-8e93-0221c7e54271", "tag": "15eacb4a-a968-4c7a-8e62-e27f90bfd84e"}]} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:26:21.381110 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:26:21.381110 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: warnings.warn(msg) Dec 14 03:26:21.390595 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [req-715258bd-f0e7-4713-8303-bd16345f58cd req-1020a324-a603-45d1-9640-e739c86ad5fe service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:21.391359 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [req-715258bd-f0e7-4713-8303-bd16345f58cd req-1020a324-a603-45d1-9640-e739c86ad5fe service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:21.443398 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.compute.server_external_events [req-715258bd-f0e7-4713-8303-bd16345f58cd req-1020a324-a603-45d1-9640-e739c86ad5fe service nova] Creating event network-changed:15eacb4a-a968-4c7a-8e62-e27f90bfd84e for instance c2f38df0-5498-4c35-8e93-0221c7e54271 on hv-cinder-81803 Dec 14 03:26:21.455008 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [req-715258bd-f0e7-4713-8303-bd16345f58cd req-1020a324-a603-45d1-9640-e739c86ad5fe service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080535 Dec 14 03:26:21.456513 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 611/1247] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Dec 14 03:26:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:26:22.077987 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-2dd2d006-af2a-4a7b-aac9-2480cd5eae92 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:26:22.078638 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-2dd2d006-af2a-4a7b-aac9-2480cd5eae92 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] [instance: c2f38df0-5498-4c35-8e93-0221c7e54271] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:26:22.084929 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2dd2d006-af2a-4a7b-aac9-2480cd5eae92 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:22.085607 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2dd2d006-af2a-4a7b-aac9-2480cd5eae92 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:22.086868 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2dd2d006-af2a-4a7b-aac9-2480cd5eae92 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:22.087386 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2dd2d006-af2a-4a7b-aac9-2480cd5eae92 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:22.221914 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-2dd2d006-af2a-4a7b-aac9-2480cd5eae92 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf869873369f496e9e25a6d6b2a7ba86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:26:22.230072 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-2dd2d006-af2a-4a7b-aac9-2480cd5eae92 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /compute/v2.1/servers/c2f38df0-5498-4c35-8e93-0221c7e54271" status: 200 len: 1265 microversion: 2.1 time: 0.156089 Dec 14 03:26:22.230641 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 637/1248] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:26:22 2021] GET /compute/v2.1/servers/c2f38df0-5498-4c35-8e93-0221c7e54271 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:26:23.247897 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-dbf83a2c-f949-416e-9fdc-7184beb593cc tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:26:23.248512 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-dbf83a2c-f949-416e-9fdc-7184beb593cc tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] [instance: c2f38df0-5498-4c35-8e93-0221c7e54271] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:26:23.254930 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-dbf83a2c-f949-416e-9fdc-7184beb593cc tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:23.255412 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-dbf83a2c-f949-416e-9fdc-7184beb593cc tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:23.256195 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-dbf83a2c-f949-416e-9fdc-7184beb593cc tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:23.256631 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-dbf83a2c-f949-416e-9fdc-7184beb593cc tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:23.389790 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-dbf83a2c-f949-416e-9fdc-7184beb593cc tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf869873369f496e9e25a6d6b2a7ba86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:26:23.397075 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-dbf83a2c-f949-416e-9fdc-7184beb593cc tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /compute/v2.1/servers/c2f38df0-5498-4c35-8e93-0221c7e54271" status: 200 len: 1265 microversion: 2.1 time: 0.154250 Dec 14 03:26:23.397668 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 612/1249] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:26:23 2021] GET /compute/v2.1/servers/c2f38df0-5498-4c35-8e93-0221c7e54271 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:26:24.413523 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-75072a04-2268-4bab-b70f-c9c908951559 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:26:24.414208 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-75072a04-2268-4bab-b70f-c9c908951559 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] [instance: c2f38df0-5498-4c35-8e93-0221c7e54271] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:26:24.425232 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-75072a04-2268-4bab-b70f-c9c908951559 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:24.425755 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-75072a04-2268-4bab-b70f-c9c908951559 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:24.426624 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-75072a04-2268-4bab-b70f-c9c908951559 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:24.427141 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-75072a04-2268-4bab-b70f-c9c908951559 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:24.569111 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-75072a04-2268-4bab-b70f-c9c908951559 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf869873369f496e9e25a6d6b2a7ba86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:26:24.578389 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-75072a04-2268-4bab-b70f-c9c908951559 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /compute/v2.1/servers/c2f38df0-5498-4c35-8e93-0221c7e54271" status: 200 len: 1265 microversion: 2.1 time: 0.168464 Dec 14 03:26:24.579709 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 638/1250] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:26:24 2021] GET /compute/v2.1/servers/c2f38df0-5498-4c35-8e93-0221c7e54271 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:26:25.595410 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-ce60486a-2686-4df0-82ff-258896df7849 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:26:25.596029 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-ce60486a-2686-4df0-82ff-258896df7849 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] [instance: c2f38df0-5498-4c35-8e93-0221c7e54271] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:26:25.602208 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ce60486a-2686-4df0-82ff-258896df7849 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:25.602660 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ce60486a-2686-4df0-82ff-258896df7849 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:25.603603 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ce60486a-2686-4df0-82ff-258896df7849 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:25.604042 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ce60486a-2686-4df0-82ff-258896df7849 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:25.823545 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-ce60486a-2686-4df0-82ff-258896df7849 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf869873369f496e9e25a6d6b2a7ba86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:26:25.830635 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-ce60486a-2686-4df0-82ff-258896df7849 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /compute/v2.1/servers/c2f38df0-5498-4c35-8e93-0221c7e54271" status: 200 len: 1265 microversion: 2.1 time: 0.238820 Dec 14 03:26:25.831229 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 613/1251] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:26:25 2021] GET /compute/v2.1/servers/c2f38df0-5498-4c35-8e93-0221c7e54271 => generated 1265 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:26:26.847889 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-fac15165-81a5-4d9a-ba3f-48bef40b6d5b tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:26:26.848539 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-fac15165-81a5-4d9a-ba3f-48bef40b6d5b tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] [instance: c2f38df0-5498-4c35-8e93-0221c7e54271] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:26:26.854796 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-fac15165-81a5-4d9a-ba3f-48bef40b6d5b tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:26.855284 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-fac15165-81a5-4d9a-ba3f-48bef40b6d5b tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:26.856065 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-fac15165-81a5-4d9a-ba3f-48bef40b6d5b tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:26.856508 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-fac15165-81a5-4d9a-ba3f-48bef40b6d5b tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:26.983529 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-fac15165-81a5-4d9a-ba3f-48bef40b6d5b tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf869873369f496e9e25a6d6b2a7ba86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:26:26.991348 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-fac15165-81a5-4d9a-ba3f-48bef40b6d5b tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /compute/v2.1/servers/c2f38df0-5498-4c35-8e93-0221c7e54271" status: 200 len: 1265 microversion: 2.1 time: 0.147120 Dec 14 03:26:26.991909 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 639/1252] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:26:26 2021] GET /compute/v2.1/servers/c2f38df0-5498-4c35-8e93-0221c7e54271 => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:26:27.795814 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-cb9aad52-2a7d-4cb9-a448-76b69315fd9a tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1127769969", "imageRef": "4fff76a9-6620-4bda-b1ec-2cd3719c946a", "flavorRef": "452", "networks": [{"uuid": "4bbf6845-f34a-4527-8c1c-a97ce74db8b8"}]}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:26:27.852230 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.network.neutron [None req-cb9aad52-2a7d-4cb9-a448-76b69315fd9a tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] validate_networks() for [('4bbf6845-f34a-4527-8c1c-a97ce74db8b8', None, None, None, None, None)] {{(pid=116071) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 14 03:26:28.008593 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-1be4632c-b5e8-46b3-a9d9-81bd6faf6ace tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:26:28.009209 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-1be4632c-b5e8-46b3-a9d9-81bd6faf6ace tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] [instance: c2f38df0-5498-4c35-8e93-0221c7e54271] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:26:28.015902 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1be4632c-b5e8-46b3-a9d9-81bd6faf6ace tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:28.016583 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1be4632c-b5e8-46b3-a9d9-81bd6faf6ace tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:28.017377 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1be4632c-b5e8-46b3-a9d9-81bd6faf6ace tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:28.017859 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1be4632c-b5e8-46b3-a9d9-81bd6faf6ace tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:28.238974 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-1be4632c-b5e8-46b3-a9d9-81bd6faf6ace tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf869873369f496e9e25a6d6b2a7ba86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:26:28.246301 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-1be4632c-b5e8-46b3-a9d9-81bd6faf6ace tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /compute/v2.1/servers/c2f38df0-5498-4c35-8e93-0221c7e54271" status: 200 len: 1265 microversion: 2.1 time: 0.241334 Dec 14 03:26:28.246856 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 640/1253] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:26:28 2021] GET /compute/v2.1/servers/c2f38df0-5498-4c35-8e93-0221c7e54271 => generated 1265 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 03:26:28.269563 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.virt.hardware [None req-cb9aad52-2a7d-4cb9-a448-76b69315fd9a tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Flavor limits 0:0:0 {{(pid=116071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 14 03:26:28.269991 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.virt.hardware [None req-cb9aad52-2a7d-4cb9-a448-76b69315fd9a tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Image limits 0:0:0 {{(pid=116071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 14 03:26:28.270470 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.virt.hardware [None req-cb9aad52-2a7d-4cb9-a448-76b69315fd9a tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Flavor pref 0:0:0 {{(pid=116071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 14 03:26:28.270882 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.virt.hardware [None req-cb9aad52-2a7d-4cb9-a448-76b69315fd9a tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Image pref 0:0:0 {{(pid=116071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 14 03:26:28.271334 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.virt.hardware [None req-cb9aad52-2a7d-4cb9-a448-76b69315fd9a tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 14 03:26:28.280572 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-cb9aad52-2a7d-4cb9-a448-76b69315fd9a tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:28.281053 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-cb9aad52-2a7d-4cb9-a448-76b69315fd9a tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:28.281877 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-cb9aad52-2a7d-4cb9-a448-76b69315fd9a tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:28.282322 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-cb9aad52-2a7d-4cb9-a448-76b69315fd9a tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:28.298196 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.quota [None req-cb9aad52-2a7d-4cb9-a448-76b69315fd9a tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Getting quotas for project 78c0550396bb4156a986650fecac5f28. Resources: {'cores', 'instances', 'ram'} {{(pid=116071) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 03:26:28.302084 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.quota [None req-cb9aad52-2a7d-4cb9-a448-76b69315fd9a tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Getting quotas for user ad04f99c1d074f4caae90b0e579ac8cd and project 78c0550396bb4156a986650fecac5f28. Resources: {'cores', 'instances', 'ram'} {{(pid=116071) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 03:26:28.313094 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-cb9aad52-2a7d-4cb9-a448-76b69315fd9a tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Going to run 1 instances... {{(pid=116071) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 14 03:26:28.315370 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-cb9aad52-2a7d-4cb9-a448-76b69315fd9a tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] [instance: 095e4cbb-3731-4cf1-85e3-8473d80de6bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4fff76a9-6620-4bda-b1ec-2cd3719c946a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 14 03:26:28.358770 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-cb9aad52-2a7d-4cb9-a448-76b69315fd9a tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.566570 Dec 14 03:26:28.359479 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 614/1254] 10.222.0.43 () {60 vars in 1146 bytes} [Tue Dec 14 03:26:27 2021] POST /compute/v2.1/servers => generated 380 bytes in 568 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 14 03:26:28.370214 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-bf03b2db-59e8-4f30-9e2b-f1f7428775e7 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:26:28.370837 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-bf03b2db-59e8-4f30-9e2b-f1f7428775e7 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] [instance: 095e4cbb-3731-4cf1-85e3-8473d80de6bb] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:26:28.422989 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-bf03b2db-59e8-4f30-9e2b-f1f7428775e7 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad04f99c1d074f4caae90b0e579ac8cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78c0550396bb4156a986650fecac5f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:26:28.429693 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-bf03b2db-59e8-4f30-9e2b-f1f7428775e7 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] 10.222.0.43 "GET /compute/v2.1/servers/095e4cbb-3731-4cf1-85e3-8473d80de6bb" status: 200 len: 1214 microversion: 2.1 time: 0.063583 Dec 14 03:26:28.430575 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 641/1255] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:26:28 2021] GET /compute/v2.1/servers/095e4cbb-3731-4cf1-85e3-8473d80de6bb => generated 1214 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:26:29.264339 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-f5eb0317-a25f-4da9-8aa5-f52e0f7ee70d tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:26:29.265162 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-f5eb0317-a25f-4da9-8aa5-f52e0f7ee70d tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] [instance: c2f38df0-5498-4c35-8e93-0221c7e54271] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:26:29.272173 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-f5eb0317-a25f-4da9-8aa5-f52e0f7ee70d tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:29.272712 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-f5eb0317-a25f-4da9-8aa5-f52e0f7ee70d tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:29.273702 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-f5eb0317-a25f-4da9-8aa5-f52e0f7ee70d tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:29.274357 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-f5eb0317-a25f-4da9-8aa5-f52e0f7ee70d tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:29.450400 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-99e0618b-01b0-4c0a-8f5b-7561d4240bf1 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:26:29.451925 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-99e0618b-01b0-4c0a-8f5b-7561d4240bf1 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] [instance: 095e4cbb-3731-4cf1-85e3-8473d80de6bb] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:26:29.460957 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-99e0618b-01b0-4c0a-8f5b-7561d4240bf1 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:29.461676 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-99e0618b-01b0-4c0a-8f5b-7561d4240bf1 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:29.462887 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-99e0618b-01b0-4c0a-8f5b-7561d4240bf1 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:29.463922 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-99e0618b-01b0-4c0a-8f5b-7561d4240bf1 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:29.504499 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-f5eb0317-a25f-4da9-8aa5-f52e0f7ee70d tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf869873369f496e9e25a6d6b2a7ba86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:26:29.512795 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-f5eb0317-a25f-4da9-8aa5-f52e0f7ee70d tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /compute/v2.1/servers/c2f38df0-5498-4c35-8e93-0221c7e54271" status: 200 len: 1265 microversion: 2.1 time: 0.253805 Dec 14 03:26:29.513592 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 615/1256] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:26:29 2021] GET /compute/v2.1/servers/c2f38df0-5498-4c35-8e93-0221c7e54271 => generated 1265 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:26:29.545890 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-99e0618b-01b0-4c0a-8f5b-7561d4240bf1 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad04f99c1d074f4caae90b0e579ac8cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78c0550396bb4156a986650fecac5f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:26:29.556032 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-99e0618b-01b0-4c0a-8f5b-7561d4240bf1 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] 10.222.0.43 "GET /compute/v2.1/servers/095e4cbb-3731-4cf1-85e3-8473d80de6bb" status: 200 len: 1272 microversion: 2.1 time: 0.110103 Dec 14 03:26:29.557505 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 642/1257] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:26:29 2021] GET /compute/v2.1/servers/095e4cbb-3731-4cf1-85e3-8473d80de6bb => generated 1272 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:26:30.530512 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-383c20d3-2435-4dd1-ae37-0cce36861e5a tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:26:30.531897 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-383c20d3-2435-4dd1-ae37-0cce36861e5a tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] [instance: c2f38df0-5498-4c35-8e93-0221c7e54271] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:26:30.537932 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-383c20d3-2435-4dd1-ae37-0cce36861e5a tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:30.538718 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-383c20d3-2435-4dd1-ae37-0cce36861e5a tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:30.539619 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-383c20d3-2435-4dd1-ae37-0cce36861e5a tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:30.540134 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-383c20d3-2435-4dd1-ae37-0cce36861e5a tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:30.575200 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-a6aa9575-8265-480b-ae56-603605b579cf tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:26:30.575825 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-a6aa9575-8265-480b-ae56-603605b579cf tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] [instance: 095e4cbb-3731-4cf1-85e3-8473d80de6bb] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:26:30.582449 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a6aa9575-8265-480b-ae56-603605b579cf tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:30.582906 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a6aa9575-8265-480b-ae56-603605b579cf tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:30.583727 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a6aa9575-8265-480b-ae56-603605b579cf tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:30.584165 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a6aa9575-8265-480b-ae56-603605b579cf tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:30.841726 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-383c20d3-2435-4dd1-ae37-0cce36861e5a tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf869873369f496e9e25a6d6b2a7ba86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:26:30.849961 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-a6aa9575-8265-480b-ae56-603605b579cf tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad04f99c1d074f4caae90b0e579ac8cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78c0550396bb4156a986650fecac5f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:26:30.852056 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-383c20d3-2435-4dd1-ae37-0cce36861e5a tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /compute/v2.1/servers/c2f38df0-5498-4c35-8e93-0221c7e54271" status: 200 len: 1265 microversion: 2.1 time: 0.325574 Dec 14 03:26:30.853979 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 616/1258] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:26:30 2021] GET /compute/v2.1/servers/c2f38df0-5498-4c35-8e93-0221c7e54271 => generated 1265 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:26:30.867934 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-a6aa9575-8265-480b-ae56-603605b579cf tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] 10.222.0.43 "GET /compute/v2.1/servers/095e4cbb-3731-4cf1-85e3-8473d80de6bb" status: 200 len: 1314 microversion: 2.1 time: 0.296243 Dec 14 03:26:30.868641 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 643/1259] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:26:30 2021] GET /compute/v2.1/servers/095e4cbb-3731-4cf1-85e3-8473d80de6bb => generated 1314 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 03:26:31.036513 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [req-b1782f6d-ac1e-41d5-9db5-d1e337349ea4 req-4f83c568-09f5-4202-85a9-2fcc5dd5927f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "095e4cbb-3731-4cf1-85e3-8473d80de6bb", "tag": "4540549e-8d25-4a77-b531-a8cc8a115578"}]} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:26:31.038130 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:26:31.038130 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: warnings.warn(msg) Dec 14 03:26:31.046328 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [req-b1782f6d-ac1e-41d5-9db5-d1e337349ea4 req-4f83c568-09f5-4202-85a9-2fcc5dd5927f service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:31.046806 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [req-b1782f6d-ac1e-41d5-9db5-d1e337349ea4 req-4f83c568-09f5-4202-85a9-2fcc5dd5927f service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:31.060268 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.compute.server_external_events [req-b1782f6d-ac1e-41d5-9db5-d1e337349ea4 req-4f83c568-09f5-4202-85a9-2fcc5dd5927f service nova] Creating event network-changed:4540549e-8d25-4a77-b531-a8cc8a115578 for instance 095e4cbb-3731-4cf1-85e3-8473d80de6bb on hv-cinder-81803 Dec 14 03:26:31.067870 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [req-b1782f6d-ac1e-41d5-9db5-d1e337349ea4 req-4f83c568-09f5-4202-85a9-2fcc5dd5927f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034668 Dec 14 03:26:31.068595 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 617/1260] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Dec 14 03:26:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:26:31.869475 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-65e6c112-bf0b-40a6-ad80-b443acf1c1c2 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:26:31.870123 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-65e6c112-bf0b-40a6-ad80-b443acf1c1c2 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] [instance: c2f38df0-5498-4c35-8e93-0221c7e54271] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:26:31.876351 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-65e6c112-bf0b-40a6-ad80-b443acf1c1c2 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:31.876801 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-65e6c112-bf0b-40a6-ad80-b443acf1c1c2 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:31.877584 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-65e6c112-bf0b-40a6-ad80-b443acf1c1c2 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:31.878023 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-65e6c112-bf0b-40a6-ad80-b443acf1c1c2 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:31.886173 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-92a47219-503d-4861-b273-d5ae36cc62ce tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:26:31.886957 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-92a47219-503d-4861-b273-d5ae36cc62ce tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] [instance: 095e4cbb-3731-4cf1-85e3-8473d80de6bb] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:26:31.893489 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-92a47219-503d-4861-b273-d5ae36cc62ce tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:31.894057 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-92a47219-503d-4861-b273-d5ae36cc62ce tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:31.894937 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-92a47219-503d-4861-b273-d5ae36cc62ce tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:31.895528 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-92a47219-503d-4861-b273-d5ae36cc62ce tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:32.082149 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-65e6c112-bf0b-40a6-ad80-b443acf1c1c2 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf869873369f496e9e25a6d6b2a7ba86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:26:32.090074 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-92a47219-503d-4861-b273-d5ae36cc62ce tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad04f99c1d074f4caae90b0e579ac8cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78c0550396bb4156a986650fecac5f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:26:32.090417 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-65e6c112-bf0b-40a6-ad80-b443acf1c1c2 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /compute/v2.1/servers/c2f38df0-5498-4c35-8e93-0221c7e54271" status: 200 len: 1265 microversion: 2.1 time: 0.224598 Dec 14 03:26:32.090992 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 644/1261] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:26:31 2021] GET /compute/v2.1/servers/c2f38df0-5498-4c35-8e93-0221c7e54271 => generated 1265 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:26:32.097764 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-92a47219-503d-4861-b273-d5ae36cc62ce tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] 10.222.0.43 "GET /compute/v2.1/servers/095e4cbb-3731-4cf1-85e3-8473d80de6bb" status: 200 len: 1314 microversion: 2.1 time: 0.216003 Dec 14 03:26:32.098393 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 618/1262] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:26:31 2021] GET /compute/v2.1/servers/095e4cbb-3731-4cf1-85e3-8473d80de6bb => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 03:26:33.036804 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [req-7ec66c42-68b3-46e0-9293-2bb73b59fdc9 req-1cf382fe-3aa8-4b95-992b-dafc37deedca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2f38df0-5498-4c35-8e93-0221c7e54271", "name": "network-vif-plugged", "status": "completed", "tag": "15eacb4a-a968-4c7a-8e62-e27f90bfd84e"}]} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:26:33.038388 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:26:33.038388 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: warnings.warn(msg) Dec 14 03:26:33.045082 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-7ec66c42-68b3-46e0-9293-2bb73b59fdc9 req-1cf382fe-3aa8-4b95-992b-dafc37deedca service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:33.045523 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-7ec66c42-68b3-46e0-9293-2bb73b59fdc9 req-1cf382fe-3aa8-4b95-992b-dafc37deedca service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:33.056628 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.compute.server_external_events [req-7ec66c42-68b3-46e0-9293-2bb73b59fdc9 req-1cf382fe-3aa8-4b95-992b-dafc37deedca service nova] Creating event network-vif-plugged:15eacb4a-a968-4c7a-8e62-e27f90bfd84e for instance c2f38df0-5498-4c35-8e93-0221c7e54271 on hv-cinder-81803 Dec 14 03:26:33.061453 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [req-7ec66c42-68b3-46e0-9293-2bb73b59fdc9 req-1cf382fe-3aa8-4b95-992b-dafc37deedca service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.197592 Dec 14 03:26:33.062018 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 645/1263] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Dec 14 03:26:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:26:33.106927 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-ce9079d2-1885-4cd6-b044-2fb01ccff321 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:26:33.107624 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-ce9079d2-1885-4cd6-b044-2fb01ccff321 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] [instance: c2f38df0-5498-4c35-8e93-0221c7e54271] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:26:33.114484 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ce9079d2-1885-4cd6-b044-2fb01ccff321 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:33.114892 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-72252d08-c0f3-4112-83d6-bb37d31ef860 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:26:33.115015 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ce9079d2-1885-4cd6-b044-2fb01ccff321 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:33.115790 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-72252d08-c0f3-4112-83d6-bb37d31ef860 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] [instance: 095e4cbb-3731-4cf1-85e3-8473d80de6bb] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:26:33.115942 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ce9079d2-1885-4cd6-b044-2fb01ccff321 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:33.116171 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ce9079d2-1885-4cd6-b044-2fb01ccff321 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:33.122516 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-72252d08-c0f3-4112-83d6-bb37d31ef860 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:33.122678 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-72252d08-c0f3-4112-83d6-bb37d31ef860 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:33.123438 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-72252d08-c0f3-4112-83d6-bb37d31ef860 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:33.123988 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-72252d08-c0f3-4112-83d6-bb37d31ef860 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:33.310519 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-ce9079d2-1885-4cd6-b044-2fb01ccff321 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf869873369f496e9e25a6d6b2a7ba86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:26:33.316983 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-72252d08-c0f3-4112-83d6-bb37d31ef860 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad04f99c1d074f4caae90b0e579ac8cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78c0550396bb4156a986650fecac5f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:26:33.318393 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-ce9079d2-1885-4cd6-b044-2fb01ccff321 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /compute/v2.1/servers/c2f38df0-5498-4c35-8e93-0221c7e54271" status: 200 len: 1265 microversion: 2.1 time: 0.215652 Dec 14 03:26:33.318972 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 619/1264] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:26:33 2021] GET /compute/v2.1/servers/c2f38df0-5498-4c35-8e93-0221c7e54271 => generated 1265 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:26:33.326235 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-72252d08-c0f3-4112-83d6-bb37d31ef860 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] 10.222.0.43 "GET /compute/v2.1/servers/095e4cbb-3731-4cf1-85e3-8473d80de6bb" status: 200 len: 1314 microversion: 2.1 time: 0.215464 Dec 14 03:26:33.327306 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 646/1265] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:26:33 2021] GET /compute/v2.1/servers/095e4cbb-3731-4cf1-85e3-8473d80de6bb => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 03:26:34.335720 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-631be585-847e-4ba6-94df-d3b25faab20d tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:26:34.336336 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-631be585-847e-4ba6-94df-d3b25faab20d tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] [instance: c2f38df0-5498-4c35-8e93-0221c7e54271] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:26:34.343125 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-631be585-847e-4ba6-94df-d3b25faab20d tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:34.343581 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-631be585-847e-4ba6-94df-d3b25faab20d tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:34.343692 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-8c399722-829b-4228-b67c-551b32bc4cc5 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:26:34.344227 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-8c399722-829b-4228-b67c-551b32bc4cc5 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] [instance: 095e4cbb-3731-4cf1-85e3-8473d80de6bb] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:26:34.344391 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-631be585-847e-4ba6-94df-d3b25faab20d tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:34.344835 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-631be585-847e-4ba6-94df-d3b25faab20d tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:34.350338 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8c399722-829b-4228-b67c-551b32bc4cc5 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:34.350782 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8c399722-829b-4228-b67c-551b32bc4cc5 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:34.351582 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8c399722-829b-4228-b67c-551b32bc4cc5 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:34.352014 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8c399722-829b-4228-b67c-551b32bc4cc5 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:34.538495 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-631be585-847e-4ba6-94df-d3b25faab20d tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf869873369f496e9e25a6d6b2a7ba86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:26:34.541614 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-8c399722-829b-4228-b67c-551b32bc4cc5 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad04f99c1d074f4caae90b0e579ac8cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78c0550396bb4156a986650fecac5f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:26:34.545983 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-631be585-847e-4ba6-94df-d3b25faab20d tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /compute/v2.1/servers/c2f38df0-5498-4c35-8e93-0221c7e54271" status: 200 len: 1265 microversion: 2.1 time: 0.213940 Dec 14 03:26:34.546637 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 620/1266] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:26:34 2021] GET /compute/v2.1/servers/c2f38df0-5498-4c35-8e93-0221c7e54271 => generated 1265 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:26:34.549028 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-8c399722-829b-4228-b67c-551b32bc4cc5 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] 10.222.0.43 "GET /compute/v2.1/servers/095e4cbb-3731-4cf1-85e3-8473d80de6bb" status: 200 len: 1314 microversion: 2.1 time: 0.208912 Dec 14 03:26:34.549585 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 647/1267] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:26:34 2021] GET /compute/v2.1/servers/095e4cbb-3731-4cf1-85e3-8473d80de6bb => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 03:26:35.563143 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-4f95883f-e56e-4379-8a62-b32ea79ee171 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:26:35.563727 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-4f95883f-e56e-4379-8a62-b32ea79ee171 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] [instance: c2f38df0-5498-4c35-8e93-0221c7e54271] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:26:35.565202 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-0d4309ec-7142-4968-803b-dc38c59508e7 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:26:35.565822 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-0d4309ec-7142-4968-803b-dc38c59508e7 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] [instance: 095e4cbb-3731-4cf1-85e3-8473d80de6bb] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:26:35.569923 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-4f95883f-e56e-4379-8a62-b32ea79ee171 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:35.570377 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-4f95883f-e56e-4379-8a62-b32ea79ee171 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:35.571366 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-4f95883f-e56e-4379-8a62-b32ea79ee171 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:35.571813 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-4f95883f-e56e-4379-8a62-b32ea79ee171 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:35.571930 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0d4309ec-7142-4968-803b-dc38c59508e7 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:35.572338 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0d4309ec-7142-4968-803b-dc38c59508e7 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:35.573112 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0d4309ec-7142-4968-803b-dc38c59508e7 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:35.573548 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0d4309ec-7142-4968-803b-dc38c59508e7 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:35.761325 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-4f95883f-e56e-4379-8a62-b32ea79ee171 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf869873369f496e9e25a6d6b2a7ba86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:26:35.764619 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-0d4309ec-7142-4968-803b-dc38c59508e7 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad04f99c1d074f4caae90b0e579ac8cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78c0550396bb4156a986650fecac5f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:26:35.768641 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-4f95883f-e56e-4379-8a62-b32ea79ee171 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /compute/v2.1/servers/c2f38df0-5498-4c35-8e93-0221c7e54271" status: 200 len: 1452 microversion: 2.1 time: 0.209372 Dec 14 03:26:35.769210 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 621/1268] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:26:35 2021] GET /compute/v2.1/servers/c2f38df0-5498-4c35-8e93-0221c7e54271 => generated 1452 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:26:35.771695 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-0d4309ec-7142-4968-803b-dc38c59508e7 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] 10.222.0.43 "GET /compute/v2.1/servers/095e4cbb-3731-4cf1-85e3-8473d80de6bb" status: 200 len: 1314 microversion: 2.1 time: 0.210190 Dec 14 03:26:35.772253 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 648/1269] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:26:35 2021] GET /compute/v2.1/servers/095e4cbb-3731-4cf1-85e3-8473d80de6bb => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 03:26:35.784855 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-37c12e63-5234-488d-9f2e-692be6769787 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:26:35.785465 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-37c12e63-5234-488d-9f2e-692be6769787 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] [instance: c2f38df0-5498-4c35-8e93-0221c7e54271] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:26:35.791255 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-37c12e63-5234-488d-9f2e-692be6769787 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:35.791709 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-37c12e63-5234-488d-9f2e-692be6769787 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:35.792488 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-37c12e63-5234-488d-9f2e-692be6769787 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:35.792950 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-37c12e63-5234-488d-9f2e-692be6769787 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:35.922325 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-37c12e63-5234-488d-9f2e-692be6769787 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf869873369f496e9e25a6d6b2a7ba86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:26:35.929697 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-37c12e63-5234-488d-9f2e-692be6769787 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /compute/v2.1/servers/c2f38df0-5498-4c35-8e93-0221c7e54271" status: 200 len: 1452 microversion: 2.1 time: 0.148227 Dec 14 03:26:35.930261 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 622/1270] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:26:35 2021] GET /compute/v2.1/servers/c2f38df0-5498-4c35-8e93-0221c7e54271 => generated 1452 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:26:36.789275 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-76e523c9-88ad-4150-953f-29d6415cf9ea tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:26:36.791195 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-76e523c9-88ad-4150-953f-29d6415cf9ea tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] [instance: 095e4cbb-3731-4cf1-85e3-8473d80de6bb] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:26:36.797885 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-76e523c9-88ad-4150-953f-29d6415cf9ea tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:36.798593 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-76e523c9-88ad-4150-953f-29d6415cf9ea tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:36.799658 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-76e523c9-88ad-4150-953f-29d6415cf9ea tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:36.800283 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-76e523c9-88ad-4150-953f-29d6415cf9ea tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:36.897704 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [req-5ddaa299-524e-4edb-acb7-4e53aa7e7764 req-9b22f7ea-8db1-4147-82ad-2c03cf0b742a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "095e4cbb-3731-4cf1-85e3-8473d80de6bb", "name": "network-vif-plugged", "status": "completed", "tag": "4540549e-8d25-4a77-b531-a8cc8a115578"}]} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:26:36.899372 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:26:36.899372 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: warnings.warn(msg) Dec 14 03:26:36.907663 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [req-5ddaa299-524e-4edb-acb7-4e53aa7e7764 req-9b22f7ea-8db1-4147-82ad-2c03cf0b742a service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:36.908113 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [req-5ddaa299-524e-4edb-acb7-4e53aa7e7764 req-9b22f7ea-8db1-4147-82ad-2c03cf0b742a service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:36.923976 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.compute.server_external_events [req-5ddaa299-524e-4edb-acb7-4e53aa7e7764 req-9b22f7ea-8db1-4147-82ad-2c03cf0b742a service nova] Creating event network-vif-plugged:4540549e-8d25-4a77-b531-a8cc8a115578 for instance 095e4cbb-3731-4cf1-85e3-8473d80de6bb on hv-cinder-81803 Dec 14 03:26:36.929195 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [req-5ddaa299-524e-4edb-acb7-4e53aa7e7764 req-9b22f7ea-8db1-4147-82ad-2c03cf0b742a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035198 Dec 14 03:26:36.930376 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 623/1271] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Dec 14 03:26:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 14 03:26:37.248538 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-76e523c9-88ad-4150-953f-29d6415cf9ea tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad04f99c1d074f4caae90b0e579ac8cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78c0550396bb4156a986650fecac5f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:26:37.255978 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-76e523c9-88ad-4150-953f-29d6415cf9ea tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] 10.222.0.43 "GET /compute/v2.1/servers/095e4cbb-3731-4cf1-85e3-8473d80de6bb" status: 200 len: 1314 microversion: 2.1 time: 0.470477 Dec 14 03:26:37.256544 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 649/1272] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:26:36 2021] GET /compute/v2.1/servers/095e4cbb-3731-4cf1-85e3-8473d80de6bb => generated 1314 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:26:37.774842 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [req-778d602b-45d9-4812-8f65-0140eef585cb req-48a5ec09-45c2-456e-8b92-2e6d9e13b03e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2f38df0-5498-4c35-8e93-0221c7e54271", "tag": "15eacb4a-a968-4c7a-8e62-e27f90bfd84e"}]} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:26:37.776348 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:26:37.776348 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: warnings.warn(msg) Dec 14 03:26:37.783356 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [req-778d602b-45d9-4812-8f65-0140eef585cb req-48a5ec09-45c2-456e-8b92-2e6d9e13b03e service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:37.783805 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [req-778d602b-45d9-4812-8f65-0140eef585cb req-48a5ec09-45c2-456e-8b92-2e6d9e13b03e service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:37.794939 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.compute.server_external_events [req-778d602b-45d9-4812-8f65-0140eef585cb req-48a5ec09-45c2-456e-8b92-2e6d9e13b03e service nova] Creating event network-changed:15eacb4a-a968-4c7a-8e62-e27f90bfd84e for instance c2f38df0-5498-4c35-8e93-0221c7e54271 on hv-cinder-81803 Dec 14 03:26:37.799777 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [req-778d602b-45d9-4812-8f65-0140eef585cb req-48a5ec09-45c2-456e-8b92-2e6d9e13b03e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028872 Dec 14 03:26:37.800555 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 624/1273] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Dec 14 03:26:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:26:38.273398 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-af20e0ef-8bfd-4a1b-8c90-228d7f1620d6 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:26:38.274038 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-af20e0ef-8bfd-4a1b-8c90-228d7f1620d6 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] [instance: 095e4cbb-3731-4cf1-85e3-8473d80de6bb] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:26:38.281182 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-af20e0ef-8bfd-4a1b-8c90-228d7f1620d6 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:38.282131 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-af20e0ef-8bfd-4a1b-8c90-228d7f1620d6 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:38.282407 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-af20e0ef-8bfd-4a1b-8c90-228d7f1620d6 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:38.282857 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-af20e0ef-8bfd-4a1b-8c90-228d7f1620d6 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:38.426549 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-af20e0ef-8bfd-4a1b-8c90-228d7f1620d6 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad04f99c1d074f4caae90b0e579ac8cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78c0550396bb4156a986650fecac5f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:26:38.435843 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-af20e0ef-8bfd-4a1b-8c90-228d7f1620d6 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] 10.222.0.43 "GET /compute/v2.1/servers/095e4cbb-3731-4cf1-85e3-8473d80de6bb" status: 200 len: 1314 microversion: 2.1 time: 0.165958 Dec 14 03:26:38.436428 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 650/1274] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:26:38 2021] GET /compute/v2.1/servers/095e4cbb-3731-4cf1-85e3-8473d80de6bb => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:26:39.453689 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-b2de2ae7-1ca2-49c8-acca-5da4082b4a61 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:26:39.454391 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-b2de2ae7-1ca2-49c8-acca-5da4082b4a61 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] [instance: 095e4cbb-3731-4cf1-85e3-8473d80de6bb] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:26:39.460621 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b2de2ae7-1ca2-49c8-acca-5da4082b4a61 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:39.461078 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b2de2ae7-1ca2-49c8-acca-5da4082b4a61 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:39.461875 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b2de2ae7-1ca2-49c8-acca-5da4082b4a61 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:39.462348 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b2de2ae7-1ca2-49c8-acca-5da4082b4a61 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:39.591427 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-b2de2ae7-1ca2-49c8-acca-5da4082b4a61 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad04f99c1d074f4caae90b0e579ac8cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78c0550396bb4156a986650fecac5f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:26:39.598681 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-b2de2ae7-1ca2-49c8-acca-5da4082b4a61 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] 10.222.0.43 "GET /compute/v2.1/servers/095e4cbb-3731-4cf1-85e3-8473d80de6bb" status: 200 len: 1498 microversion: 2.1 time: 0.149465 Dec 14 03:26:39.599270 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 625/1275] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:26:39 2021] GET /compute/v2.1/servers/095e4cbb-3731-4cf1-85e3-8473d80de6bb => generated 1498 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:26:40.091821 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-9ae061d3-47ff-487a-ab63-6cc2e1f431e2 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:26:40.092333 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-9ae061d3-47ff-487a-ab63-6cc2e1f431e2 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] [instance: 095e4cbb-3731-4cf1-85e3-8473d80de6bb] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:26:40.098586 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9ae061d3-47ff-487a-ab63-6cc2e1f431e2 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:40.099067 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9ae061d3-47ff-487a-ab63-6cc2e1f431e2 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:40.099857 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9ae061d3-47ff-487a-ab63-6cc2e1f431e2 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:40.100307 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9ae061d3-47ff-487a-ab63-6cc2e1f431e2 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:40.124707 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-9ae061d3-47ff-487a-ab63-6cc2e1f431e2 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] [instance: 095e4cbb-3731-4cf1-85e3-8473d80de6bb] Going to try to terminate instance {{(pid=116072) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 14 03:26:40.194689 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-9ae061d3-47ff-487a-ab63-6cc2e1f431e2 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] 10.222.0.43 "DELETE /compute/v2.1/servers/095e4cbb-3731-4cf1-85e3-8473d80de6bb" status: 204 len: 0 microversion: 2.1 time: 0.106196 Dec 14 03:26:40.195346 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 651/1276] 10.222.0.43 () {58 vars in 1238 bytes} [Tue Dec 14 03:26:40 2021] DELETE /compute/v2.1/servers/095e4cbb-3731-4cf1-85e3-8473d80de6bb => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 14 03:26:40.203977 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-716bf0c2-460f-4ffb-b8a3-44862cc97908 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:26:40.204718 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-716bf0c2-460f-4ffb-b8a3-44862cc97908 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] [instance: 095e4cbb-3731-4cf1-85e3-8473d80de6bb] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:26:40.210621 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-716bf0c2-460f-4ffb-b8a3-44862cc97908 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:40.211101 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-716bf0c2-460f-4ffb-b8a3-44862cc97908 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:40.211884 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-716bf0c2-460f-4ffb-b8a3-44862cc97908 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:40.212894 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-716bf0c2-460f-4ffb-b8a3-44862cc97908 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:40.341712 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-716bf0c2-460f-4ffb-b8a3-44862cc97908 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad04f99c1d074f4caae90b0e579ac8cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78c0550396bb4156a986650fecac5f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:26:40.348882 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-716bf0c2-460f-4ffb-b8a3-44862cc97908 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] 10.222.0.43 "GET /compute/v2.1/servers/095e4cbb-3731-4cf1-85e3-8473d80de6bb" status: 200 len: 1504 microversion: 2.1 time: 0.148812 Dec 14 03:26:40.349463 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 626/1277] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:26:40 2021] GET /compute/v2.1/servers/095e4cbb-3731-4cf1-85e3-8473d80de6bb => generated 1504 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:26:41.366235 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-59c6909a-d6bb-4093-a789-9757381c0b61 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:26:41.366977 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-59c6909a-d6bb-4093-a789-9757381c0b61 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] [instance: 095e4cbb-3731-4cf1-85e3-8473d80de6bb] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:26:41.373277 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-59c6909a-d6bb-4093-a789-9757381c0b61 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:41.373734 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-59c6909a-d6bb-4093-a789-9757381c0b61 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:41.374508 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-59c6909a-d6bb-4093-a789-9757381c0b61 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:41.374948 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-59c6909a-d6bb-4093-a789-9757381c0b61 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:41.502833 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-59c6909a-d6bb-4093-a789-9757381c0b61 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad04f99c1d074f4caae90b0e579ac8cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78c0550396bb4156a986650fecac5f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:26:41.510538 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-59c6909a-d6bb-4093-a789-9757381c0b61 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] 10.222.0.43 "GET /compute/v2.1/servers/095e4cbb-3731-4cf1-85e3-8473d80de6bb" status: 200 len: 1504 microversion: 2.1 time: 0.148565 Dec 14 03:26:41.511118 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 652/1278] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:26:41 2021] GET /compute/v2.1/servers/095e4cbb-3731-4cf1-85e3-8473d80de6bb => generated 1504 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:26:42.281443 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [req-8686e2fb-a695-42d2-a2ac-40de828c7979 req-dde13be3-89c9-470a-8fff-a4d1a151555d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "095e4cbb-3731-4cf1-85e3-8473d80de6bb", "name": "network-vif-deleted", "tag": "4540549e-8d25-4a77-b531-a8cc8a115578"}]} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:26:42.283021 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:26:42.283021 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: warnings.warn(msg) Dec 14 03:26:42.291864 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [req-8686e2fb-a695-42d2-a2ac-40de828c7979 req-dde13be3-89c9-470a-8fff-a4d1a151555d service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:42.292317 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [req-8686e2fb-a695-42d2-a2ac-40de828c7979 req-dde13be3-89c9-470a-8fff-a4d1a151555d service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:42.303946 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.compute.server_external_events [req-8686e2fb-a695-42d2-a2ac-40de828c7979 req-dde13be3-89c9-470a-8fff-a4d1a151555d service nova] Creating event network-vif-deleted:4540549e-8d25-4a77-b531-a8cc8a115578 for instance 095e4cbb-3731-4cf1-85e3-8473d80de6bb on hv-cinder-81803 Dec 14 03:26:42.309604 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [req-8686e2fb-a695-42d2-a2ac-40de828c7979 req-dde13be3-89c9-470a-8fff-a4d1a151555d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031905 Dec 14 03:26:42.310600 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 627/1279] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Dec 14 03:26:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:26:42.528478 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-64f9ba02-e6b6-4be4-ad75-ed6f44bbbad3 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:26:42.529025 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-64f9ba02-e6b6-4be4-ad75-ed6f44bbbad3 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] [instance: 095e4cbb-3731-4cf1-85e3-8473d80de6bb] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:26:42.535423 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-64f9ba02-e6b6-4be4-ad75-ed6f44bbbad3 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:42.535878 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-64f9ba02-e6b6-4be4-ad75-ed6f44bbbad3 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:42.536654 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-64f9ba02-e6b6-4be4-ad75-ed6f44bbbad3 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:42.537092 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-64f9ba02-e6b6-4be4-ad75-ed6f44bbbad3 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:42.566467 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-64f9ba02-e6b6-4be4-ad75-ed6f44bbbad3 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:42.566919 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-64f9ba02-e6b6-4be4-ad75-ed6f44bbbad3 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:42.567395 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.objects.instance [None req-64f9ba02-e6b6-4be4-ad75-ed6f44bbbad3 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lazy-loading 'fault' on Instance uuid 095e4cbb-3731-4cf1-85e3-8473d80de6bb {{(pid=116072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 14 03:26:42.604777 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-64f9ba02-e6b6-4be4-ad75-ed6f44bbbad3 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad04f99c1d074f4caae90b0e579ac8cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78c0550396bb4156a986650fecac5f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:26:42.612016 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-64f9ba02-e6b6-4be4-ad75-ed6f44bbbad3 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] 10.222.0.43 "GET /compute/v2.1/servers/095e4cbb-3731-4cf1-85e3-8473d80de6bb" status: 200 len: 1304 microversion: 2.1 time: 0.087868 Dec 14 03:26:42.612846 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 653/1280] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:26:42 2021] GET /compute/v2.1/servers/095e4cbb-3731-4cf1-85e3-8473d80de6bb => generated 1304 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:26:43.630607 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-b1d675d9-75b0-4c4a-ba63-4b1c0b012980 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:26:43.631334 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-b1d675d9-75b0-4c4a-ba63-4b1c0b012980 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] [instance: 095e4cbb-3731-4cf1-85e3-8473d80de6bb] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:26:43.637334 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b1d675d9-75b0-4c4a-ba63-4b1c0b012980 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:43.637782 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b1d675d9-75b0-4c4a-ba63-4b1c0b012980 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:43.638555 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b1d675d9-75b0-4c4a-ba63-4b1c0b012980 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:43.638986 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b1d675d9-75b0-4c4a-ba63-4b1c0b012980 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:43.652455 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.wsgi [None req-b1d675d9-75b0-4c4a-ba63-4b1c0b012980 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] HTTP exception thrown: Instance 095e4cbb-3731-4cf1-85e3-8473d80de6bb could not be found. Dec 14 03:26:43.653031 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-b1d675d9-75b0-4c4a-ba63-4b1c0b012980 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Returning 404 to user: Instance 095e4cbb-3731-4cf1-85e3-8473d80de6bb could not be found. {{(pid=116071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 03:26:43.653826 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-b1d675d9-75b0-4c4a-ba63-4b1c0b012980 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] 10.222.0.43 "GET /compute/v2.1/servers/095e4cbb-3731-4cf1-85e3-8473d80de6bb" status: 404 len: 111 microversion: 2.1 time: 0.027674 Dec 14 03:26:43.654490 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 628/1281] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:26:43 2021] GET /compute/v2.1/servers/095e4cbb-3731-4cf1-85e3-8473d80de6bb => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 14 03:26:43.746597 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-6b850429-b3aa-4170-809c-be3a262d8c0d tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1196195069", "imageRef": "4fff76a9-6620-4bda-b1ec-2cd3719c946a", "flavorRef": "452", "networks": [{"uuid": "4bbf6845-f34a-4527-8c1c-a97ce74db8b8"}]}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:26:43.799971 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.network.neutron [None req-6b850429-b3aa-4170-809c-be3a262d8c0d tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] validate_networks() for [('4bbf6845-f34a-4527-8c1c-a97ce74db8b8', None, None, None, None, None)] {{(pid=116072) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 14 03:26:44.223892 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-6b850429-b3aa-4170-809c-be3a262d8c0d tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Flavor limits 0:0:0 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 14 03:26:44.224314 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-6b850429-b3aa-4170-809c-be3a262d8c0d tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Image limits 0:0:0 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 14 03:26:44.224783 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-6b850429-b3aa-4170-809c-be3a262d8c0d tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Flavor pref 0:0:0 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 14 03:26:44.225187 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-6b850429-b3aa-4170-809c-be3a262d8c0d tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Image pref 0:0:0 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 14 03:26:44.225593 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-6b850429-b3aa-4170-809c-be3a262d8c0d tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 14 03:26:44.234618 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6b850429-b3aa-4170-809c-be3a262d8c0d tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:44.235097 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6b850429-b3aa-4170-809c-be3a262d8c0d tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:44.235937 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6b850429-b3aa-4170-809c-be3a262d8c0d tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:44.236372 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6b850429-b3aa-4170-809c-be3a262d8c0d tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:44.252275 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.quota [None req-6b850429-b3aa-4170-809c-be3a262d8c0d tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Getting quotas for project 78c0550396bb4156a986650fecac5f28. Resources: {'cores', 'instances', 'ram'} {{(pid=116072) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 03:26:44.256073 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.quota [None req-6b850429-b3aa-4170-809c-be3a262d8c0d tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Getting quotas for user ad04f99c1d074f4caae90b0e579ac8cd and project 78c0550396bb4156a986650fecac5f28. Resources: {'cores', 'instances', 'ram'} {{(pid=116072) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 03:26:44.266309 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-6b850429-b3aa-4170-809c-be3a262d8c0d tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Going to run 1 instances... {{(pid=116072) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 14 03:26:44.268599 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-6b850429-b3aa-4170-809c-be3a262d8c0d tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] [instance: 50748e4e-0c67-4ef1-b581-fbbe246bb0a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4fff76a9-6620-4bda-b1ec-2cd3719c946a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 14 03:26:44.312487 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-6b850429-b3aa-4170-809c-be3a262d8c0d tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.569515 Dec 14 03:26:44.313123 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 654/1282] 10.222.0.43 () {60 vars in 1146 bytes} [Tue Dec 14 03:26:43 2021] POST /compute/v2.1/servers => generated 380 bytes in 571 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 14 03:26:44.322866 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-139cf96c-934a-484e-85ab-da24851c2b80 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:26:44.323511 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-139cf96c-934a-484e-85ab-da24851c2b80 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] [instance: 50748e4e-0c67-4ef1-b581-fbbe246bb0a4] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:26:44.376294 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-139cf96c-934a-484e-85ab-da24851c2b80 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad04f99c1d074f4caae90b0e579ac8cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78c0550396bb4156a986650fecac5f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:26:44.383217 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-139cf96c-934a-484e-85ab-da24851c2b80 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] 10.222.0.43 "GET /compute/v2.1/servers/50748e4e-0c67-4ef1-b581-fbbe246bb0a4" status: 200 len: 1214 microversion: 2.1 time: 0.064018 Dec 14 03:26:44.383889 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 629/1283] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:26:44 2021] GET /compute/v2.1/servers/50748e4e-0c67-4ef1-b581-fbbe246bb0a4 => generated 1214 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:26:45.401829 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-20bae4bd-8a69-4043-911a-1ff1b22e8ba8 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:26:45.402449 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-20bae4bd-8a69-4043-911a-1ff1b22e8ba8 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] [instance: 50748e4e-0c67-4ef1-b581-fbbe246bb0a4] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:26:45.409399 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-20bae4bd-8a69-4043-911a-1ff1b22e8ba8 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:45.409769 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-20bae4bd-8a69-4043-911a-1ff1b22e8ba8 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:45.410552 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-20bae4bd-8a69-4043-911a-1ff1b22e8ba8 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:45.411305 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-20bae4bd-8a69-4043-911a-1ff1b22e8ba8 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:45.480558 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-20bae4bd-8a69-4043-911a-1ff1b22e8ba8 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad04f99c1d074f4caae90b0e579ac8cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78c0550396bb4156a986650fecac5f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:26:45.488204 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-20bae4bd-8a69-4043-911a-1ff1b22e8ba8 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] 10.222.0.43 "GET /compute/v2.1/servers/50748e4e-0c67-4ef1-b581-fbbe246bb0a4" status: 200 len: 1272 microversion: 2.1 time: 0.091172 Dec 14 03:26:45.488771 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 655/1284] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:26:45 2021] GET /compute/v2.1/servers/50748e4e-0c67-4ef1-b581-fbbe246bb0a4 => generated 1272 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:26:46.504980 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-f8c0d9fe-0dcf-48b2-b3f3-e7ac1514afca tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:26:46.505601 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-f8c0d9fe-0dcf-48b2-b3f3-e7ac1514afca tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] [instance: 50748e4e-0c67-4ef1-b581-fbbe246bb0a4] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:26:46.511909 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [req-cdcc1aa8-0416-4d81-a63b-e091773c0b93 req-3f3acece-e1c3-4000-bc86-2ba12822fc1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50748e4e-0c67-4ef1-b581-fbbe246bb0a4", "tag": "25dd1574-96e1-476d-8ff3-adcbac643dd9"}]} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:26:46.513793 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-f8c0d9fe-0dcf-48b2-b3f3-e7ac1514afca tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:46.514327 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-f8c0d9fe-0dcf-48b2-b3f3-e7ac1514afca tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:46.515230 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-f8c0d9fe-0dcf-48b2-b3f3-e7ac1514afca tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:46.515702 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-f8c0d9fe-0dcf-48b2-b3f3-e7ac1514afca tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:46.515850 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:26:46.515850 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: warnings.warn(msg) Dec 14 03:26:46.523984 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-cdcc1aa8-0416-4d81-a63b-e091773c0b93 req-3f3acece-e1c3-4000-bc86-2ba12822fc1e service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:46.524571 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-cdcc1aa8-0416-4d81-a63b-e091773c0b93 req-3f3acece-e1c3-4000-bc86-2ba12822fc1e service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:46.536106 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.compute.server_external_events [req-cdcc1aa8-0416-4d81-a63b-e091773c0b93 req-3f3acece-e1c3-4000-bc86-2ba12822fc1e service nova] Creating event network-changed:25dd1574-96e1-476d-8ff3-adcbac643dd9 for instance 50748e4e-0c67-4ef1-b581-fbbe246bb0a4 on hv-cinder-81803 Dec 14 03:26:46.541807 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [req-cdcc1aa8-0416-4d81-a63b-e091773c0b93 req-3f3acece-e1c3-4000-bc86-2ba12822fc1e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035724 Dec 14 03:26:46.542404 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 656/1285] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Dec 14 03:26:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:26:46.659296 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-f8c0d9fe-0dcf-48b2-b3f3-e7ac1514afca tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad04f99c1d074f4caae90b0e579ac8cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78c0550396bb4156a986650fecac5f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:26:46.666665 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-f8c0d9fe-0dcf-48b2-b3f3-e7ac1514afca tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] 10.222.0.43 "GET /compute/v2.1/servers/50748e4e-0c67-4ef1-b581-fbbe246bb0a4" status: 200 len: 1314 microversion: 2.1 time: 0.165386 Dec 14 03:26:46.667320 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 630/1286] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:26:46 2021] GET /compute/v2.1/servers/50748e4e-0c67-4ef1-b581-fbbe246bb0a4 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:26:47.684096 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-74c3ff30-1ffb-42cf-bd43-c71c5b0b83b8 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:26:47.684801 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-74c3ff30-1ffb-42cf-bd43-c71c5b0b83b8 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] [instance: 50748e4e-0c67-4ef1-b581-fbbe246bb0a4] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:26:47.690849 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-74c3ff30-1ffb-42cf-bd43-c71c5b0b83b8 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:47.691346 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-74c3ff30-1ffb-42cf-bd43-c71c5b0b83b8 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:47.692133 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-74c3ff30-1ffb-42cf-bd43-c71c5b0b83b8 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:47.692567 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-74c3ff30-1ffb-42cf-bd43-c71c5b0b83b8 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:47.926353 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-74c3ff30-1ffb-42cf-bd43-c71c5b0b83b8 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad04f99c1d074f4caae90b0e579ac8cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78c0550396bb4156a986650fecac5f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:26:47.934025 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-74c3ff30-1ffb-42cf-bd43-c71c5b0b83b8 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] 10.222.0.43 "GET /compute/v2.1/servers/50748e4e-0c67-4ef1-b581-fbbe246bb0a4" status: 200 len: 1314 microversion: 2.1 time: 0.254429 Dec 14 03:26:47.934599 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 657/1287] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:26:47 2021] GET /compute/v2.1/servers/50748e4e-0c67-4ef1-b581-fbbe246bb0a4 => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:26:48.950394 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-cf49ce39-72eb-47bd-af45-03d3ec042e8a tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:26:48.950977 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-cf49ce39-72eb-47bd-af45-03d3ec042e8a tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] [instance: 50748e4e-0c67-4ef1-b581-fbbe246bb0a4] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:26:48.957281 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-cf49ce39-72eb-47bd-af45-03d3ec042e8a tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:48.957730 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-cf49ce39-72eb-47bd-af45-03d3ec042e8a tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:48.958511 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-cf49ce39-72eb-47bd-af45-03d3ec042e8a tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:48.958946 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-cf49ce39-72eb-47bd-af45-03d3ec042e8a tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:49.088539 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-cf49ce39-72eb-47bd-af45-03d3ec042e8a tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad04f99c1d074f4caae90b0e579ac8cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78c0550396bb4156a986650fecac5f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:26:49.096115 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-cf49ce39-72eb-47bd-af45-03d3ec042e8a tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] 10.222.0.43 "GET /compute/v2.1/servers/50748e4e-0c67-4ef1-b581-fbbe246bb0a4" status: 200 len: 1314 microversion: 2.1 time: 0.149414 Dec 14 03:26:49.096679 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 631/1288] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:26:48 2021] GET /compute/v2.1/servers/50748e4e-0c67-4ef1-b581-fbbe246bb0a4 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:26:50.113548 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-6d3f5b9b-eb96-418f-ae47-1ee690636c86 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:26:50.114166 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-6d3f5b9b-eb96-418f-ae47-1ee690636c86 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] [instance: 50748e4e-0c67-4ef1-b581-fbbe246bb0a4] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:26:50.120481 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6d3f5b9b-eb96-418f-ae47-1ee690636c86 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:50.120933 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6d3f5b9b-eb96-418f-ae47-1ee690636c86 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:50.121711 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6d3f5b9b-eb96-418f-ae47-1ee690636c86 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:50.122150 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6d3f5b9b-eb96-418f-ae47-1ee690636c86 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:50.247833 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-6d3f5b9b-eb96-418f-ae47-1ee690636c86 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad04f99c1d074f4caae90b0e579ac8cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78c0550396bb4156a986650fecac5f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:26:50.255022 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-6d3f5b9b-eb96-418f-ae47-1ee690636c86 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] 10.222.0.43 "GET /compute/v2.1/servers/50748e4e-0c67-4ef1-b581-fbbe246bb0a4" status: 200 len: 1314 microversion: 2.1 time: 0.145313 Dec 14 03:26:50.255615 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 658/1289] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:26:50 2021] GET /compute/v2.1/servers/50748e4e-0c67-4ef1-b581-fbbe246bb0a4 => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 03:26:51.272491 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-91a1bd11-2a57-47ad-9ccd-33fa8c4f9670 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:26:51.273055 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-91a1bd11-2a57-47ad-9ccd-33fa8c4f9670 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] [instance: 50748e4e-0c67-4ef1-b581-fbbe246bb0a4] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:26:51.279340 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-91a1bd11-2a57-47ad-9ccd-33fa8c4f9670 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:51.279800 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-91a1bd11-2a57-47ad-9ccd-33fa8c4f9670 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:51.280577 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-91a1bd11-2a57-47ad-9ccd-33fa8c4f9670 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:51.281013 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-91a1bd11-2a57-47ad-9ccd-33fa8c4f9670 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:51.410772 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-91a1bd11-2a57-47ad-9ccd-33fa8c4f9670 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad04f99c1d074f4caae90b0e579ac8cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78c0550396bb4156a986650fecac5f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:26:51.418086 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-91a1bd11-2a57-47ad-9ccd-33fa8c4f9670 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] 10.222.0.43 "GET /compute/v2.1/servers/50748e4e-0c67-4ef1-b581-fbbe246bb0a4" status: 200 len: 1314 microversion: 2.1 time: 0.149367 Dec 14 03:26:51.418688 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 632/1290] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:26:51 2021] GET /compute/v2.1/servers/50748e4e-0c67-4ef1-b581-fbbe246bb0a4 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:26:52.436018 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-2ed5c613-6105-40d3-a43f-8ad7b8a430c2 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:26:52.436628 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-2ed5c613-6105-40d3-a43f-8ad7b8a430c2 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] [instance: 50748e4e-0c67-4ef1-b581-fbbe246bb0a4] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:26:52.442471 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2ed5c613-6105-40d3-a43f-8ad7b8a430c2 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:52.442915 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2ed5c613-6105-40d3-a43f-8ad7b8a430c2 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:52.443715 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2ed5c613-6105-40d3-a43f-8ad7b8a430c2 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:52.444175 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2ed5c613-6105-40d3-a43f-8ad7b8a430c2 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:52.570166 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-2ed5c613-6105-40d3-a43f-8ad7b8a430c2 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad04f99c1d074f4caae90b0e579ac8cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78c0550396bb4156a986650fecac5f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:26:52.577169 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-2ed5c613-6105-40d3-a43f-8ad7b8a430c2 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] 10.222.0.43 "GET /compute/v2.1/servers/50748e4e-0c67-4ef1-b581-fbbe246bb0a4" status: 200 len: 1314 microversion: 2.1 time: 0.145366 Dec 14 03:26:52.577731 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 659/1291] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:26:52 2021] GET /compute/v2.1/servers/50748e4e-0c67-4ef1-b581-fbbe246bb0a4 => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:26:53.002551 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [req-dceeabdb-da46-40ee-9077-79d879039ef2 req-fe9f75e8-a8a3-44ad-9105-83ec6cf38e9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50748e4e-0c67-4ef1-b581-fbbe246bb0a4", "name": "network-vif-plugged", "status": "completed", "tag": "25dd1574-96e1-476d-8ff3-adcbac643dd9"}]} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:26:53.004105 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:26:53.004105 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: warnings.warn(msg) Dec 14 03:26:53.011883 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [req-dceeabdb-da46-40ee-9077-79d879039ef2 req-fe9f75e8-a8a3-44ad-9105-83ec6cf38e9e service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:53.012173 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [req-dceeabdb-da46-40ee-9077-79d879039ef2 req-fe9f75e8-a8a3-44ad-9105-83ec6cf38e9e service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:53.022943 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.compute.server_external_events [req-dceeabdb-da46-40ee-9077-79d879039ef2 req-fe9f75e8-a8a3-44ad-9105-83ec6cf38e9e service nova] Creating event network-vif-plugged:25dd1574-96e1-476d-8ff3-adcbac643dd9 for instance 50748e4e-0c67-4ef1-b581-fbbe246bb0a4 on hv-cinder-81803 Dec 14 03:26:53.028296 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [req-dceeabdb-da46-40ee-9077-79d879039ef2 req-fe9f75e8-a8a3-44ad-9105-83ec6cf38e9e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029504 Dec 14 03:26:53.028878 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 633/1292] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Dec 14 03:26:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:26:53.594428 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-7c566888-9141-4047-96ae-d590aa40e117 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:26:53.595058 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-7c566888-9141-4047-96ae-d590aa40e117 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] [instance: 50748e4e-0c67-4ef1-b581-fbbe246bb0a4] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:26:53.601203 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7c566888-9141-4047-96ae-d590aa40e117 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:53.601649 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7c566888-9141-4047-96ae-d590aa40e117 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:53.604039 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7c566888-9141-4047-96ae-d590aa40e117 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:53.604482 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7c566888-9141-4047-96ae-d590aa40e117 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:53.731741 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-7c566888-9141-4047-96ae-d590aa40e117 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad04f99c1d074f4caae90b0e579ac8cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78c0550396bb4156a986650fecac5f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:26:53.739158 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-7c566888-9141-4047-96ae-d590aa40e117 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] 10.222.0.43 "GET /compute/v2.1/servers/50748e4e-0c67-4ef1-b581-fbbe246bb0a4" status: 200 len: 1314 microversion: 2.1 time: 0.148283 Dec 14 03:26:53.740208 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 660/1293] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:26:53 2021] GET /compute/v2.1/servers/50748e4e-0c67-4ef1-b581-fbbe246bb0a4 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:26:54.757054 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-00d84a5b-ffbc-4445-989e-7af7ef78d062 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:26:54.757749 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-00d84a5b-ffbc-4445-989e-7af7ef78d062 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] [instance: 50748e4e-0c67-4ef1-b581-fbbe246bb0a4] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:26:54.764246 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-00d84a5b-ffbc-4445-989e-7af7ef78d062 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:54.764717 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-00d84a5b-ffbc-4445-989e-7af7ef78d062 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:54.765469 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-00d84a5b-ffbc-4445-989e-7af7ef78d062 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:54.765903 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-00d84a5b-ffbc-4445-989e-7af7ef78d062 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:54.891621 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-00d84a5b-ffbc-4445-989e-7af7ef78d062 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad04f99c1d074f4caae90b0e579ac8cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78c0550396bb4156a986650fecac5f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:26:54.898767 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-00d84a5b-ffbc-4445-989e-7af7ef78d062 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] 10.222.0.43 "GET /compute/v2.1/servers/50748e4e-0c67-4ef1-b581-fbbe246bb0a4" status: 200 len: 1498 microversion: 2.1 time: 0.146219 Dec 14 03:26:54.899354 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 634/1294] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:26:54 2021] GET /compute/v2.1/servers/50748e4e-0c67-4ef1-b581-fbbe246bb0a4 => generated 1498 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:26:55.401023 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-7332aa31-b930-409e-8b95-a1c52709fe3f tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:26:55.401500 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-7332aa31-b930-409e-8b95-a1c52709fe3f tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] [instance: 50748e4e-0c67-4ef1-b581-fbbe246bb0a4] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:26:55.407802 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7332aa31-b930-409e-8b95-a1c52709fe3f tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:55.408254 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7332aa31-b930-409e-8b95-a1c52709fe3f tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:55.409032 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7332aa31-b930-409e-8b95-a1c52709fe3f tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:55.409464 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7332aa31-b930-409e-8b95-a1c52709fe3f tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:55.434650 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-7332aa31-b930-409e-8b95-a1c52709fe3f tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] [instance: 50748e4e-0c67-4ef1-b581-fbbe246bb0a4] Going to try to terminate instance {{(pid=116072) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 14 03:26:55.505145 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-7332aa31-b930-409e-8b95-a1c52709fe3f tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] 10.222.0.43 "DELETE /compute/v2.1/servers/50748e4e-0c67-4ef1-b581-fbbe246bb0a4" status: 204 len: 0 microversion: 2.1 time: 0.107504 Dec 14 03:26:55.505721 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 661/1295] 10.222.0.43 () {58 vars in 1238 bytes} [Tue Dec 14 03:26:55 2021] DELETE /compute/v2.1/servers/50748e4e-0c67-4ef1-b581-fbbe246bb0a4 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 14 03:26:55.515918 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-c93c90c1-c0c8-48b4-bd67-894e26d389d5 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:26:55.516523 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-c93c90c1-c0c8-48b4-bd67-894e26d389d5 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] [instance: 50748e4e-0c67-4ef1-b581-fbbe246bb0a4] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:26:55.522310 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c93c90c1-c0c8-48b4-bd67-894e26d389d5 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:55.522755 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c93c90c1-c0c8-48b4-bd67-894e26d389d5 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:55.523550 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c93c90c1-c0c8-48b4-bd67-894e26d389d5 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:55.523981 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c93c90c1-c0c8-48b4-bd67-894e26d389d5 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:55.654496 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-c93c90c1-c0c8-48b4-bd67-894e26d389d5 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad04f99c1d074f4caae90b0e579ac8cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78c0550396bb4156a986650fecac5f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:26:55.661933 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-c93c90c1-c0c8-48b4-bd67-894e26d389d5 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] 10.222.0.43 "GET /compute/v2.1/servers/50748e4e-0c67-4ef1-b581-fbbe246bb0a4" status: 200 len: 1504 microversion: 2.1 time: 0.150794 Dec 14 03:26:55.662499 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 635/1296] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:26:55 2021] GET /compute/v2.1/servers/50748e4e-0c67-4ef1-b581-fbbe246bb0a4 => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:26:56.680149 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-6349cdac-3dbb-4056-aa99-19f03b74fcf4 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:26:56.680850 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-6349cdac-3dbb-4056-aa99-19f03b74fcf4 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] [instance: 50748e4e-0c67-4ef1-b581-fbbe246bb0a4] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:26:56.687683 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6349cdac-3dbb-4056-aa99-19f03b74fcf4 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:56.688116 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6349cdac-3dbb-4056-aa99-19f03b74fcf4 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:56.688896 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6349cdac-3dbb-4056-aa99-19f03b74fcf4 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:56.689331 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6349cdac-3dbb-4056-aa99-19f03b74fcf4 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:56.815754 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-6349cdac-3dbb-4056-aa99-19f03b74fcf4 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad04f99c1d074f4caae90b0e579ac8cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78c0550396bb4156a986650fecac5f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:26:56.822985 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-6349cdac-3dbb-4056-aa99-19f03b74fcf4 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] 10.222.0.43 "GET /compute/v2.1/servers/50748e4e-0c67-4ef1-b581-fbbe246bb0a4" status: 200 len: 1504 microversion: 2.1 time: 0.146794 Dec 14 03:26:56.823571 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 662/1297] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:26:56 2021] GET /compute/v2.1/servers/50748e4e-0c67-4ef1-b581-fbbe246bb0a4 => generated 1504 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:26:57.640357 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [req-a70e5345-ec15-4890-a904-d6a770385389 req-4ff7e24b-704d-4a27-87f1-24e7b9fb9086 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50748e4e-0c67-4ef1-b581-fbbe246bb0a4", "name": "network-vif-deleted", "tag": "25dd1574-96e1-476d-8ff3-adcbac643dd9"}]} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:26:57.642427 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:26:57.642427 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: warnings.warn(msg) Dec 14 03:26:57.649886 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [req-a70e5345-ec15-4890-a904-d6a770385389 req-4ff7e24b-704d-4a27-87f1-24e7b9fb9086 service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:57.650832 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [req-a70e5345-ec15-4890-a904-d6a770385389 req-4ff7e24b-704d-4a27-87f1-24e7b9fb9086 service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:57.661959 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.compute.server_external_events [req-a70e5345-ec15-4890-a904-d6a770385389 req-4ff7e24b-704d-4a27-87f1-24e7b9fb9086 service nova] Creating event network-vif-deleted:25dd1574-96e1-476d-8ff3-adcbac643dd9 for instance 50748e4e-0c67-4ef1-b581-fbbe246bb0a4 on hv-cinder-81803 Dec 14 03:26:57.667282 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [req-a70e5345-ec15-4890-a904-d6a770385389 req-4ff7e24b-704d-4a27-87f1-24e7b9fb9086 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030729 Dec 14 03:26:57.667878 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 636/1298] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Dec 14 03:26:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:26:57.840310 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-7f206df6-589f-4e29-9604-ae2c583a5637 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:26:57.840964 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-7f206df6-589f-4e29-9604-ae2c583a5637 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] [instance: 50748e4e-0c67-4ef1-b581-fbbe246bb0a4] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:26:57.847255 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7f206df6-589f-4e29-9604-ae2c583a5637 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:57.847716 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7f206df6-589f-4e29-9604-ae2c583a5637 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:57.848504 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7f206df6-589f-4e29-9604-ae2c583a5637 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:57.848943 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7f206df6-589f-4e29-9604-ae2c583a5637 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:57.879310 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7f206df6-589f-4e29-9604-ae2c583a5637 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:57.879763 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7f206df6-589f-4e29-9604-ae2c583a5637 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:57.880209 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.objects.instance [None req-7f206df6-589f-4e29-9604-ae2c583a5637 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lazy-loading 'fault' on Instance uuid 50748e4e-0c67-4ef1-b581-fbbe246bb0a4 {{(pid=116072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 14 03:26:57.918112 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-7f206df6-589f-4e29-9604-ae2c583a5637 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad04f99c1d074f4caae90b0e579ac8cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78c0550396bb4156a986650fecac5f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:26:57.925244 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-7f206df6-589f-4e29-9604-ae2c583a5637 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] 10.222.0.43 "GET /compute/v2.1/servers/50748e4e-0c67-4ef1-b581-fbbe246bb0a4" status: 200 len: 1304 microversion: 2.1 time: 0.089065 Dec 14 03:26:57.925809 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 663/1299] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:26:57 2021] GET /compute/v2.1/servers/50748e4e-0c67-4ef1-b581-fbbe246bb0a4 => generated 1304 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:26:58.943925 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-e4ec8f38-0985-4457-9b0e-78c0d391b335 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:26:58.944550 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-e4ec8f38-0985-4457-9b0e-78c0d391b335 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] [instance: 50748e4e-0c67-4ef1-b581-fbbe246bb0a4] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:26:58.950616 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-e4ec8f38-0985-4457-9b0e-78c0d391b335 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:58.951082 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-e4ec8f38-0985-4457-9b0e-78c0d391b335 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:58.951863 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-e4ec8f38-0985-4457-9b0e-78c0d391b335 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:26:58.952304 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-e4ec8f38-0985-4457-9b0e-78c0d391b335 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:26:58.964939 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.wsgi [None req-e4ec8f38-0985-4457-9b0e-78c0d391b335 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] HTTP exception thrown: Instance 50748e4e-0c67-4ef1-b581-fbbe246bb0a4 could not be found. Dec 14 03:26:58.965518 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-e4ec8f38-0985-4457-9b0e-78c0d391b335 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] Returning 404 to user: Instance 50748e4e-0c67-4ef1-b581-fbbe246bb0a4 could not be found. {{(pid=116071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 03:26:58.966314 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-e4ec8f38-0985-4457-9b0e-78c0d391b335 tempest-VolumesActionsTest-525916093 tempest-VolumesActionsTest-525916093-project] 10.222.0.43 "GET /compute/v2.1/servers/50748e4e-0c67-4ef1-b581-fbbe246bb0a4" status: 404 len: 111 microversion: 2.1 time: 0.027083 Dec 14 03:26:58.966822 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 637/1300] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:26:58 2021] GET /compute/v2.1/servers/50748e4e-0c67-4ef1-b581-fbbe246bb0a4 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 14 03:27:32.014549 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-fce6027f-4920-43b9-8d08-55d19c1e4310 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Action: 'create', calling method: .version_select at 0x7fa5037770d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1944630018"}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:27:32.028448 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.quota [None req-fce6027f-4920-43b9-8d08-55d19c1e4310 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Getting quotas for project 84ffd96b68cf41c5a9be418ed8c0c61a. Resources: {'key_pairs'} {{(pid=116072) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 03:27:32.032555 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.quota [None req-fce6027f-4920-43b9-8d08-55d19c1e4310 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Getting quotas for user a82d0b9a044e43fba9a353b54b74c680 and project 84ffd96b68cf41c5a9be418ed8c0c61a. Resources: {'key_pairs'} {{(pid=116072) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 03:27:32.191086 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.quota [None req-fce6027f-4920-43b9-8d08-55d19c1e4310 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Getting quotas for project 84ffd96b68cf41c5a9be418ed8c0c61a. Resources: {'key_pairs'} {{(pid=116072) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 03:27:32.194944 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.quota [None req-fce6027f-4920-43b9-8d08-55d19c1e4310 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Getting quotas for user a82d0b9a044e43fba9a353b54b74c680 and project 84ffd96b68cf41c5a9be418ed8c0c61a. Resources: {'key_pairs'} {{(pid=116072) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 03:27:32.209303 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-fce6027f-4920-43b9-8d08-55d19c1e4310 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 2312 microversion: 2.1 time: 0.350542 Dec 14 03:27:32.216178 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 664/1301] 10.222.0.43 () {60 vars in 1157 bytes} [Tue Dec 14 03:27:31 2021] POST /compute/v2.1/os-keypairs => generated 2312 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:27:56.675288 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-25e402e4-8fd0-4626-9558-70409946757e tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-915552776", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1944630018", "security_groups": [{"name": "tempest-secgroup-smoke-1495078552"}], "networks": [{"uuid": "1a26c104-e4b3-4523-972d-5602ee9f495b"}], "block_device_mapping_v2": [{"uuid": "7ca55813-a43f-4cf6-9742-f740f029f398", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:27:56.784164 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.network.neutron [None req-25e402e4-8fd0-4626-9558-70409946757e tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] validate_networks() for [('1a26c104-e4b3-4523-972d-5602ee9f495b', None, None, None, None, None)] {{(pid=116071) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 14 03:27:57.517510 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.virt.hardware [None req-25e402e4-8fd0-4626-9558-70409946757e tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Flavor limits 0:0:0 {{(pid=116071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 14 03:27:57.517932 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.virt.hardware [None req-25e402e4-8fd0-4626-9558-70409946757e tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Image limits 0:0:0 {{(pid=116071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 14 03:27:57.518408 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.virt.hardware [None req-25e402e4-8fd0-4626-9558-70409946757e tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Flavor pref 0:0:0 {{(pid=116071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 14 03:27:57.518816 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.virt.hardware [None req-25e402e4-8fd0-4626-9558-70409946757e tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Image pref 0:0:0 {{(pid=116071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 14 03:27:57.519259 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.virt.hardware [None req-25e402e4-8fd0-4626-9558-70409946757e tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 14 03:27:57.528144 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-25e402e4-8fd0-4626-9558-70409946757e tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:27:57.528591 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-25e402e4-8fd0-4626-9558-70409946757e tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:27:57.529405 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-25e402e4-8fd0-4626-9558-70409946757e tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:27:57.529841 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-25e402e4-8fd0-4626-9558-70409946757e tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:27:57.546460 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.quota [None req-25e402e4-8fd0-4626-9558-70409946757e tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Getting quotas for project 84ffd96b68cf41c5a9be418ed8c0c61a. Resources: {'cores', 'instances', 'ram'} {{(pid=116071) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 03:27:57.550308 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.quota [None req-25e402e4-8fd0-4626-9558-70409946757e tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Getting quotas for user a82d0b9a044e43fba9a353b54b74c680 and project 84ffd96b68cf41c5a9be418ed8c0c61a. Resources: {'cores', 'instances', 'ram'} {{(pid=116071) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 03:27:57.603232 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-25e402e4-8fd0-4626-9558-70409946757e tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Going to run 1 instances... {{(pid=116071) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 14 03:27:57.605548 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-25e402e4-8fd0-4626-9558-70409946757e tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] [instance: ebdfbba3-0077-46f6-af60-35f085357682] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7ca55813-a43f-4cf6-9742-f740f029f398',volume_size=None,volume_type=None)] {{(pid=116071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 14 03:27:57.728071 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-25e402e4-8fd0-4626-9558-70409946757e tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.057209 Dec 14 03:27:57.729040 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 638/1302] 10.222.0.43 () {60 vars in 1146 bytes} [Tue Dec 14 03:27:56 2021] POST /compute/v2.1/servers => generated 406 bytes in 1059 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 14 03:27:57.739511 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-12efea71-b918-47f0-b5f3-8ef189211ef8 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:27:57.740652 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-12efea71-b918-47f0-b5f3-8ef189211ef8 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] [instance: ebdfbba3-0077-46f6-af60-35f085357682] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:27:57.793042 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-12efea71-b918-47f0-b5f3-8ef189211ef8 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82d0b9a044e43fba9a353b54b74c680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:27:57.800241 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-12efea71-b918-47f0-b5f3-8ef189211ef8 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /compute/v2.1/servers/ebdfbba3-0077-46f6-af60-35f085357682" status: 200 len: 1088 microversion: 2.1 time: 0.065460 Dec 14 03:27:57.800796 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 665/1303] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:27:57 2021] GET /compute/v2.1/servers/ebdfbba3-0077-46f6-af60-35f085357682 => generated 1088 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:27:58.818014 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-4ea60279-fefc-4abc-a075-6985c0e835b8 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:27:58.819197 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-4ea60279-fefc-4abc-a075-6985c0e835b8 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] [instance: ebdfbba3-0077-46f6-af60-35f085357682] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:27:58.825756 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-4ea60279-fefc-4abc-a075-6985c0e835b8 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:27:58.826211 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-4ea60279-fefc-4abc-a075-6985c0e835b8 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:27:58.827000 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-4ea60279-fefc-4abc-a075-6985c0e835b8 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:27:58.827464 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-4ea60279-fefc-4abc-a075-6985c0e835b8 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:27:58.903754 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-4ea60279-fefc-4abc-a075-6985c0e835b8 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82d0b9a044e43fba9a353b54b74c680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:27:58.911627 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-4ea60279-fefc-4abc-a075-6985c0e835b8 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /compute/v2.1/servers/ebdfbba3-0077-46f6-af60-35f085357682" status: 200 len: 1204 microversion: 2.1 time: 0.098383 Dec 14 03:27:58.912337 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 639/1304] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:27:58 2021] GET /compute/v2.1/servers/ebdfbba3-0077-46f6-af60-35f085357682 => generated 1204 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:27:59.932638 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-358ae5cf-01b4-4a34-a260-894ae71de759 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:27:59.933850 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-358ae5cf-01b4-4a34-a260-894ae71de759 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] [instance: ebdfbba3-0077-46f6-af60-35f085357682] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:27:59.939430 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-358ae5cf-01b4-4a34-a260-894ae71de759 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:27:59.940229 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-358ae5cf-01b4-4a34-a260-894ae71de759 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:27:59.941025 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-358ae5cf-01b4-4a34-a260-894ae71de759 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:27:59.941632 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-358ae5cf-01b4-4a34-a260-894ae71de759 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:28:00.145717 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-358ae5cf-01b4-4a34-a260-894ae71de759 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82d0b9a044e43fba9a353b54b74c680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:28:00.153575 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-358ae5cf-01b4-4a34-a260-894ae71de759 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /compute/v2.1/servers/ebdfbba3-0077-46f6-af60-35f085357682" status: 200 len: 1260 microversion: 2.1 time: 0.228595 Dec 14 03:28:00.154143 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 666/1305] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:27:59 2021] GET /compute/v2.1/servers/ebdfbba3-0077-46f6-af60-35f085357682 => generated 1260 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:28:00.328862 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [req-b928aac4-ef29-456a-8a34-2a5bc1b7c116 req-462c2314-ff20-4fe6-95b8-5173b941dab9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebdfbba3-0077-46f6-af60-35f085357682", "tag": "f5625fc9-aa99-4f98-9a5d-b0f54296bb68"}]} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:28:00.330632 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:28:00.330632 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: warnings.warn(msg) Dec 14 03:28:00.338090 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [req-b928aac4-ef29-456a-8a34-2a5bc1b7c116 req-462c2314-ff20-4fe6-95b8-5173b941dab9 service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:28:00.338630 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [req-b928aac4-ef29-456a-8a34-2a5bc1b7c116 req-462c2314-ff20-4fe6-95b8-5173b941dab9 service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:28:00.350263 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.compute.server_external_events [req-b928aac4-ef29-456a-8a34-2a5bc1b7c116 req-462c2314-ff20-4fe6-95b8-5173b941dab9 service nova] Creating event network-changed:f5625fc9-aa99-4f98-9a5d-b0f54296bb68 for instance ebdfbba3-0077-46f6-af60-35f085357682 on hv-cinder-81803 Dec 14 03:28:00.355600 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [req-b928aac4-ef29-456a-8a34-2a5bc1b7c116 req-462c2314-ff20-4fe6-95b8-5173b941dab9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140867 Dec 14 03:28:00.356367 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 640/1306] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Dec 14 03:28:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:28:01.170899 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-ec622f39-44b6-4ceb-a801-a9a8e4e507da tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:28:01.171556 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-ec622f39-44b6-4ceb-a801-a9a8e4e507da tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] [instance: ebdfbba3-0077-46f6-af60-35f085357682] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:28:01.177752 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ec622f39-44b6-4ceb-a801-a9a8e4e507da tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:28:01.178201 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ec622f39-44b6-4ceb-a801-a9a8e4e507da tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:28:01.178986 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ec622f39-44b6-4ceb-a801-a9a8e4e507da tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:28:01.179449 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ec622f39-44b6-4ceb-a801-a9a8e4e507da tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:28:01.316097 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-ec622f39-44b6-4ceb-a801-a9a8e4e507da tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82d0b9a044e43fba9a353b54b74c680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:28:01.323295 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-ec622f39-44b6-4ceb-a801-a9a8e4e507da tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /compute/v2.1/servers/ebdfbba3-0077-46f6-af60-35f085357682" status: 200 len: 1260 microversion: 2.1 time: 0.156030 Dec 14 03:28:01.324347 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 667/1307] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:28:01 2021] GET /compute/v2.1/servers/ebdfbba3-0077-46f6-af60-35f085357682 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:28:02.341724 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-3de842b4-9196-40d0-bc7b-c22215588858 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:28:02.342420 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-3de842b4-9196-40d0-bc7b-c22215588858 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] [instance: ebdfbba3-0077-46f6-af60-35f085357682] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:28:02.348475 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-3de842b4-9196-40d0-bc7b-c22215588858 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:28:02.348929 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-3de842b4-9196-40d0-bc7b-c22215588858 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:28:02.349708 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-3de842b4-9196-40d0-bc7b-c22215588858 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:28:02.350156 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-3de842b4-9196-40d0-bc7b-c22215588858 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:28:02.478024 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-3de842b4-9196-40d0-bc7b-c22215588858 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82d0b9a044e43fba9a353b54b74c680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:28:02.485729 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-3de842b4-9196-40d0-bc7b-c22215588858 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /compute/v2.1/servers/ebdfbba3-0077-46f6-af60-35f085357682" status: 200 len: 1260 microversion: 2.1 time: 0.149127 Dec 14 03:28:02.486282 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 641/1308] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:28:02 2021] GET /compute/v2.1/servers/ebdfbba3-0077-46f6-af60-35f085357682 => generated 1260 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:28:03.503104 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-091748e7-bcc5-41bd-99e2-4ee6d2bb87ab tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:28:03.503748 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-091748e7-bcc5-41bd-99e2-4ee6d2bb87ab tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] [instance: ebdfbba3-0077-46f6-af60-35f085357682] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:28:03.510151 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-091748e7-bcc5-41bd-99e2-4ee6d2bb87ab tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:28:03.510616 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-091748e7-bcc5-41bd-99e2-4ee6d2bb87ab tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:28:03.511435 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-091748e7-bcc5-41bd-99e2-4ee6d2bb87ab tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:28:03.511881 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-091748e7-bcc5-41bd-99e2-4ee6d2bb87ab tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:28:03.642194 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-091748e7-bcc5-41bd-99e2-4ee6d2bb87ab tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82d0b9a044e43fba9a353b54b74c680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:28:03.649593 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-091748e7-bcc5-41bd-99e2-4ee6d2bb87ab tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /compute/v2.1/servers/ebdfbba3-0077-46f6-af60-35f085357682" status: 200 len: 1260 microversion: 2.1 time: 0.150060 Dec 14 03:28:03.650194 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 668/1309] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:28:03 2021] GET /compute/v2.1/servers/ebdfbba3-0077-46f6-af60-35f085357682 => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:28:04.666637 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-6ba2d643-6b68-418e-a06e-8c9e50812386 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:28:04.667787 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-6ba2d643-6b68-418e-a06e-8c9e50812386 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] [instance: ebdfbba3-0077-46f6-af60-35f085357682] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:28:04.674062 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-6ba2d643-6b68-418e-a06e-8c9e50812386 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:28:04.674510 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-6ba2d643-6b68-418e-a06e-8c9e50812386 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:28:04.675546 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-6ba2d643-6b68-418e-a06e-8c9e50812386 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:28:04.675988 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-6ba2d643-6b68-418e-a06e-8c9e50812386 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:28:04.804009 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-6ba2d643-6b68-418e-a06e-8c9e50812386 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82d0b9a044e43fba9a353b54b74c680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:28:04.811702 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-6ba2d643-6b68-418e-a06e-8c9e50812386 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /compute/v2.1/servers/ebdfbba3-0077-46f6-af60-35f085357682" status: 200 len: 1260 microversion: 2.1 time: 0.148711 Dec 14 03:28:04.812252 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 642/1310] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:28:04 2021] GET /compute/v2.1/servers/ebdfbba3-0077-46f6-af60-35f085357682 => generated 1260 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:28:05.828268 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-827497e7-c3d0-47d2-b506-00ae694624a2 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:28:05.828888 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-827497e7-c3d0-47d2-b506-00ae694624a2 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] [instance: ebdfbba3-0077-46f6-af60-35f085357682] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:28:05.835300 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-827497e7-c3d0-47d2-b506-00ae694624a2 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:28:05.835756 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-827497e7-c3d0-47d2-b506-00ae694624a2 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:28:05.836539 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-827497e7-c3d0-47d2-b506-00ae694624a2 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:28:05.836979 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-827497e7-c3d0-47d2-b506-00ae694624a2 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:28:05.968020 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-827497e7-c3d0-47d2-b506-00ae694624a2 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82d0b9a044e43fba9a353b54b74c680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:28:05.975168 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-827497e7-c3d0-47d2-b506-00ae694624a2 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /compute/v2.1/servers/ebdfbba3-0077-46f6-af60-35f085357682" status: 200 len: 1260 microversion: 2.1 time: 0.150536 Dec 14 03:28:05.975729 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 669/1311] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:28:05 2021] GET /compute/v2.1/servers/ebdfbba3-0077-46f6-af60-35f085357682 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:28:06.992907 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-2658eae1-1291-4ce4-82b9-85ae17435249 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:28:06.993526 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-2658eae1-1291-4ce4-82b9-85ae17435249 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] [instance: ebdfbba3-0077-46f6-af60-35f085357682] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:28:07.000561 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-2658eae1-1291-4ce4-82b9-85ae17435249 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:28:07.001017 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-2658eae1-1291-4ce4-82b9-85ae17435249 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:28:07.001805 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-2658eae1-1291-4ce4-82b9-85ae17435249 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:28:07.002247 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-2658eae1-1291-4ce4-82b9-85ae17435249 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:28:07.129026 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-2658eae1-1291-4ce4-82b9-85ae17435249 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82d0b9a044e43fba9a353b54b74c680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:28:07.136277 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-2658eae1-1291-4ce4-82b9-85ae17435249 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /compute/v2.1/servers/ebdfbba3-0077-46f6-af60-35f085357682" status: 200 len: 1260 microversion: 2.1 time: 0.146998 Dec 14 03:28:07.136843 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 643/1312] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:28:06 2021] GET /compute/v2.1/servers/ebdfbba3-0077-46f6-af60-35f085357682 => generated 1260 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:28:08.153365 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-125dd69b-560a-4334-8830-ce40a3303f12 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:28:08.153983 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-125dd69b-560a-4334-8830-ce40a3303f12 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] [instance: ebdfbba3-0077-46f6-af60-35f085357682] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:28:08.160246 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-125dd69b-560a-4334-8830-ce40a3303f12 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:28:08.160714 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-125dd69b-560a-4334-8830-ce40a3303f12 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:28:08.161490 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-125dd69b-560a-4334-8830-ce40a3303f12 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:28:08.161927 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-125dd69b-560a-4334-8830-ce40a3303f12 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:28:08.289047 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-125dd69b-560a-4334-8830-ce40a3303f12 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82d0b9a044e43fba9a353b54b74c680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:28:08.296157 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-125dd69b-560a-4334-8830-ce40a3303f12 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /compute/v2.1/servers/ebdfbba3-0077-46f6-af60-35f085357682" status: 200 len: 1260 microversion: 2.1 time: 0.146439 Dec 14 03:28:08.296719 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 670/1313] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:28:08 2021] GET /compute/v2.1/servers/ebdfbba3-0077-46f6-af60-35f085357682 => generated 1260 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:28:09.312490 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-99d1559b-70f3-4ce3-97b1-2b8607195513 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:28:09.313103 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-99d1559b-70f3-4ce3-97b1-2b8607195513 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] [instance: ebdfbba3-0077-46f6-af60-35f085357682] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:28:09.319383 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-99d1559b-70f3-4ce3-97b1-2b8607195513 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:28:09.319836 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-99d1559b-70f3-4ce3-97b1-2b8607195513 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:28:09.320612 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-99d1559b-70f3-4ce3-97b1-2b8607195513 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:28:09.321052 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-99d1559b-70f3-4ce3-97b1-2b8607195513 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:28:09.452132 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-99d1559b-70f3-4ce3-97b1-2b8607195513 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82d0b9a044e43fba9a353b54b74c680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:28:09.459504 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-99d1559b-70f3-4ce3-97b1-2b8607195513 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /compute/v2.1/servers/ebdfbba3-0077-46f6-af60-35f085357682" status: 200 len: 1260 microversion: 2.1 time: 0.150641 Dec 14 03:28:09.460064 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 644/1314] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:28:09 2021] GET /compute/v2.1/servers/ebdfbba3-0077-46f6-af60-35f085357682 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:28:10.476627 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-a6277186-3ea3-4469-a5b5-a040f059cb1e tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:28:10.477222 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-a6277186-3ea3-4469-a5b5-a040f059cb1e tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] [instance: ebdfbba3-0077-46f6-af60-35f085357682] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:28:10.484252 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a6277186-3ea3-4469-a5b5-a040f059cb1e tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:28:10.484693 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a6277186-3ea3-4469-a5b5-a040f059cb1e tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:28:10.485463 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a6277186-3ea3-4469-a5b5-a040f059cb1e tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:28:10.485887 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a6277186-3ea3-4469-a5b5-a040f059cb1e tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:28:10.614683 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-a6277186-3ea3-4469-a5b5-a040f059cb1e tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82d0b9a044e43fba9a353b54b74c680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:28:10.622346 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-a6277186-3ea3-4469-a5b5-a040f059cb1e tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /compute/v2.1/servers/ebdfbba3-0077-46f6-af60-35f085357682" status: 200 len: 1260 microversion: 2.1 time: 0.149364 Dec 14 03:28:10.622908 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 671/1315] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:28:10 2021] GET /compute/v2.1/servers/ebdfbba3-0077-46f6-af60-35f085357682 => generated 1260 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:28:10.928726 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 14 03:28:10.929266 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: Tue Dec 14 03:28:10 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 14 03:28:11.638943 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-2ffdc33d-b2af-4d63-9e31-667fa4c9a5f9 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:28:11.639502 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-2ffdc33d-b2af-4d63-9e31-667fa4c9a5f9 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] [instance: ebdfbba3-0077-46f6-af60-35f085357682] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:28:11.645791 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-2ffdc33d-b2af-4d63-9e31-667fa4c9a5f9 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:28:11.646237 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-2ffdc33d-b2af-4d63-9e31-667fa4c9a5f9 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:28:11.647008 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-2ffdc33d-b2af-4d63-9e31-667fa4c9a5f9 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:28:11.647469 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-2ffdc33d-b2af-4d63-9e31-667fa4c9a5f9 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:28:11.781027 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-2ffdc33d-b2af-4d63-9e31-667fa4c9a5f9 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82d0b9a044e43fba9a353b54b74c680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:28:11.794566 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-2ffdc33d-b2af-4d63-9e31-667fa4c9a5f9 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /compute/v2.1/servers/ebdfbba3-0077-46f6-af60-35f085357682" status: 200 len: 1260 microversion: 2.1 time: 0.159242 Dec 14 03:28:11.795507 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 645/1316] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:28:11 2021] GET /compute/v2.1/servers/ebdfbba3-0077-46f6-af60-35f085357682 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:28:11.829122 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [req-a7907eb4-bdf9-47f7-977d-73a982677924 req-07b6c68f-0021-4bd3-a539-5a6541ea2d37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebdfbba3-0077-46f6-af60-35f085357682", "name": "network-vif-plugged", "status": "completed", "tag": "f5625fc9-aa99-4f98-9a5d-b0f54296bb68"}]} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:28:11.830696 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:28:11.830696 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: warnings.warn(msg) Dec 14 03:28:11.837992 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-a7907eb4-bdf9-47f7-977d-73a982677924 req-07b6c68f-0021-4bd3-a539-5a6541ea2d37 service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:28:11.838981 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-a7907eb4-bdf9-47f7-977d-73a982677924 req-07b6c68f-0021-4bd3-a539-5a6541ea2d37 service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:28:11.850093 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.compute.server_external_events [req-a7907eb4-bdf9-47f7-977d-73a982677924 req-07b6c68f-0021-4bd3-a539-5a6541ea2d37 service nova] Creating event network-vif-plugged:f5625fc9-aa99-4f98-9a5d-b0f54296bb68 for instance ebdfbba3-0077-46f6-af60-35f085357682 on hv-cinder-81803 Dec 14 03:28:11.855582 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [req-a7907eb4-bdf9-47f7-977d-73a982677924 req-07b6c68f-0021-4bd3-a539-5a6541ea2d37 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030092 Dec 14 03:28:11.856173 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 672/1317] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Dec 14 03:28:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:28:12.812184 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-de2b8158-ba99-42c8-a2da-693d2d000fda tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:28:12.812801 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-de2b8158-ba99-42c8-a2da-693d2d000fda tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] [instance: ebdfbba3-0077-46f6-af60-35f085357682] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:28:12.819003 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-de2b8158-ba99-42c8-a2da-693d2d000fda tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:28:12.819476 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-de2b8158-ba99-42c8-a2da-693d2d000fda tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:28:12.820248 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-de2b8158-ba99-42c8-a2da-693d2d000fda tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:28:12.820684 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-de2b8158-ba99-42c8-a2da-693d2d000fda tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:28:12.947654 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-de2b8158-ba99-42c8-a2da-693d2d000fda tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82d0b9a044e43fba9a353b54b74c680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:28:12.954970 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-de2b8158-ba99-42c8-a2da-693d2d000fda tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /compute/v2.1/servers/ebdfbba3-0077-46f6-af60-35f085357682" status: 200 len: 1260 microversion: 2.1 time: 0.146656 Dec 14 03:28:12.955558 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 646/1318] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:28:12 2021] GET /compute/v2.1/servers/ebdfbba3-0077-46f6-af60-35f085357682 => generated 1260 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:28:13.972561 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-0468a8c4-bc36-4a85-b958-ff5a9385bbfc tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:28:13.973181 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-0468a8c4-bc36-4a85-b958-ff5a9385bbfc tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] [instance: ebdfbba3-0077-46f6-af60-35f085357682] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:28:13.979199 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0468a8c4-bc36-4a85-b958-ff5a9385bbfc tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:28:13.979657 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0468a8c4-bc36-4a85-b958-ff5a9385bbfc tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:28:13.980427 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0468a8c4-bc36-4a85-b958-ff5a9385bbfc tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:28:13.980865 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0468a8c4-bc36-4a85-b958-ff5a9385bbfc tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:28:14.112508 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-0468a8c4-bc36-4a85-b958-ff5a9385bbfc tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82d0b9a044e43fba9a353b54b74c680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:28:14.120464 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-0468a8c4-bc36-4a85-b958-ff5a9385bbfc tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /compute/v2.1/servers/ebdfbba3-0077-46f6-af60-35f085357682" status: 200 len: 1444 microversion: 2.1 time: 0.151923 Dec 14 03:28:14.121015 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 673/1319] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:28:13 2021] GET /compute/v2.1/servers/ebdfbba3-0077-46f6-af60-35f085357682 => generated 1444 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:28:14.136881 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-8bc842f6-4b33-44ee-9441-7dad789e40eb tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:28:14.137493 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-8bc842f6-4b33-44ee-9441-7dad789e40eb tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] [instance: ebdfbba3-0077-46f6-af60-35f085357682] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:28:14.143724 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-8bc842f6-4b33-44ee-9441-7dad789e40eb tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:28:14.144200 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-8bc842f6-4b33-44ee-9441-7dad789e40eb tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:28:14.144975 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-8bc842f6-4b33-44ee-9441-7dad789e40eb tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:28:14.145407 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-8bc842f6-4b33-44ee-9441-7dad789e40eb tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:28:14.273747 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-8bc842f6-4b33-44ee-9441-7dad789e40eb tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82d0b9a044e43fba9a353b54b74c680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:28:14.280900 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-8bc842f6-4b33-44ee-9441-7dad789e40eb tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /compute/v2.1/servers/ebdfbba3-0077-46f6-af60-35f085357682" status: 200 len: 1444 microversion: 2.1 time: 0.148184 Dec 14 03:28:14.281449 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 647/1320] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:28:14 2021] GET /compute/v2.1/servers/ebdfbba3-0077-46f6-af60-35f085357682 => generated 1444 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:28:16.131067 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [req-bbc25a8d-0430-498e-9924-9956d5526cec req-68ded1b5-1c57-47c6-80da-0ec255c3fdc5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebdfbba3-0077-46f6-af60-35f085357682", "tag": "f5625fc9-aa99-4f98-9a5d-b0f54296bb68"}]} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:28:16.132758 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:28:16.132758 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: warnings.warn(msg) Dec 14 03:28:16.140322 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-bbc25a8d-0430-498e-9924-9956d5526cec req-68ded1b5-1c57-47c6-80da-0ec255c3fdc5 service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:28:16.140770 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-bbc25a8d-0430-498e-9924-9956d5526cec req-68ded1b5-1c57-47c6-80da-0ec255c3fdc5 service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:28:16.151359 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.compute.server_external_events [req-bbc25a8d-0430-498e-9924-9956d5526cec req-68ded1b5-1c57-47c6-80da-0ec255c3fdc5 service nova] Creating event network-changed:f5625fc9-aa99-4f98-9a5d-b0f54296bb68 for instance ebdfbba3-0077-46f6-af60-35f085357682 on hv-cinder-81803 Dec 14 03:28:16.156163 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [req-bbc25a8d-0430-498e-9924-9956d5526cec req-68ded1b5-1c57-47c6-80da-0ec255c3fdc5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028727 Dec 14 03:28:16.156749 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 674/1321] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Dec 14 03:28:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:28:52.285297 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-4bf7276c-22ea-4ded-b341-6f141066b3af tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1270385348", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-801497898", "security_groups": [{"name": "tempest-secgroup-smoke-201763541"}], "block_device_mapping_v2": [{"uuid": "b66f5881-0d54-4937-808f-dd2b0c3b45e1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8f2d77d5-e58c-4a97-8899-5e1a2da29f69"}]}} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:28:52.390388 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.network.neutron [None req-4bf7276c-22ea-4ded-b341-6f141066b3af tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] validate_networks() for [('8f2d77d5-e58c-4a97-8899-5e1a2da29f69', None, None, None, None, None)] {{(pid=116071) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 14 03:28:52.744832 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.virt.hardware [None req-4bf7276c-22ea-4ded-b341-6f141066b3af tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Flavor limits 0:0:0 {{(pid=116071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 14 03:28:52.745359 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.virt.hardware [None req-4bf7276c-22ea-4ded-b341-6f141066b3af tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Image limits 0:0:0 {{(pid=116071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 14 03:28:52.745911 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.virt.hardware [None req-4bf7276c-22ea-4ded-b341-6f141066b3af tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Flavor pref 0:0:0 {{(pid=116071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 14 03:28:52.746393 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.virt.hardware [None req-4bf7276c-22ea-4ded-b341-6f141066b3af tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Image pref 0:0:0 {{(pid=116071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 14 03:28:52.746889 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.virt.hardware [None req-4bf7276c-22ea-4ded-b341-6f141066b3af tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 14 03:28:52.756515 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-4bf7276c-22ea-4ded-b341-6f141066b3af tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:28:52.756972 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-4bf7276c-22ea-4ded-b341-6f141066b3af tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:28:52.757828 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-4bf7276c-22ea-4ded-b341-6f141066b3af tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:28:52.758273 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-4bf7276c-22ea-4ded-b341-6f141066b3af tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:28:52.774377 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.quota [None req-4bf7276c-22ea-4ded-b341-6f141066b3af tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Getting quotas for project d0c4dcf4957d42b896f04f682afeef7b. Resources: {'cores', 'instances', 'ram'} {{(pid=116071) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 03:28:52.778788 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.quota [None req-4bf7276c-22ea-4ded-b341-6f141066b3af tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Getting quotas for user bf869873369f496e9e25a6d6b2a7ba86 and project d0c4dcf4957d42b896f04f682afeef7b. Resources: {'cores', 'instances', 'ram'} {{(pid=116071) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 03:28:52.831731 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-4bf7276c-22ea-4ded-b341-6f141066b3af tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Going to run 1 instances... {{(pid=116071) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 14 03:28:52.833876 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-4bf7276c-22ea-4ded-b341-6f141066b3af tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] [instance: b8269bb0-71ca-4269-ae95-6ccd9614cf1e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b66f5881-0d54-4937-808f-dd2b0c3b45e1',volume_size=None,volume_type=None)] {{(pid=116071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 14 03:28:52.953298 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-4bf7276c-22ea-4ded-b341-6f141066b3af tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.671588 Dec 14 03:28:52.953929 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 648/1322] 10.222.0.43 () {60 vars in 1146 bytes} [Tue Dec 14 03:28:52 2021] POST /compute/v2.1/servers => generated 405 bytes in 673 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 14 03:28:52.964560 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-86baea83-0b23-48ba-bf5a-47f305d89815 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:28:52.965253 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-86baea83-0b23-48ba-bf5a-47f305d89815 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] [instance: b8269bb0-71ca-4269-ae95-6ccd9614cf1e] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:28:53.024372 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-86baea83-0b23-48ba-bf5a-47f305d89815 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf869873369f496e9e25a6d6b2a7ba86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:28:53.030931 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-86baea83-0b23-48ba-bf5a-47f305d89815 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /compute/v2.1/servers/b8269bb0-71ca-4269-ae95-6ccd9614cf1e" status: 200 len: 1094 microversion: 2.1 time: 0.070826 Dec 14 03:28:53.031630 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 675/1323] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:28:52 2021] GET /compute/v2.1/servers/b8269bb0-71ca-4269-ae95-6ccd9614cf1e => generated 1094 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:28:54.047622 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-5593fc84-1835-4de4-a15e-a2984a2dae82 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:28:54.048153 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-5593fc84-1835-4de4-a15e-a2984a2dae82 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] [instance: b8269bb0-71ca-4269-ae95-6ccd9614cf1e] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:28:54.054619 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-5593fc84-1835-4de4-a15e-a2984a2dae82 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:28:54.055100 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-5593fc84-1835-4de4-a15e-a2984a2dae82 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:28:54.055875 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-5593fc84-1835-4de4-a15e-a2984a2dae82 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:28:54.056323 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-5593fc84-1835-4de4-a15e-a2984a2dae82 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:28:54.114296 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-5593fc84-1835-4de4-a15e-a2984a2dae82 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf869873369f496e9e25a6d6b2a7ba86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:28:54.122062 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-5593fc84-1835-4de4-a15e-a2984a2dae82 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /compute/v2.1/servers/b8269bb0-71ca-4269-ae95-6ccd9614cf1e" status: 200 len: 1192 microversion: 2.1 time: 0.078730 Dec 14 03:28:54.122623 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 649/1324] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:28:54 2021] GET /compute/v2.1/servers/b8269bb0-71ca-4269-ae95-6ccd9614cf1e => generated 1192 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 03:28:55.138521 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-71a3b35a-c88b-47f6-b781-1fe56e518e9d tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:28:55.139456 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-71a3b35a-c88b-47f6-b781-1fe56e518e9d tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] [instance: b8269bb0-71ca-4269-ae95-6ccd9614cf1e] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:28:55.147155 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-71a3b35a-c88b-47f6-b781-1fe56e518e9d tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:28:55.147609 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-71a3b35a-c88b-47f6-b781-1fe56e518e9d tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:28:55.148405 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-71a3b35a-c88b-47f6-b781-1fe56e518e9d tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:28:55.149241 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-71a3b35a-c88b-47f6-b781-1fe56e518e9d tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:28:55.351420 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-71a3b35a-c88b-47f6-b781-1fe56e518e9d tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf869873369f496e9e25a6d6b2a7ba86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:28:55.359033 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-71a3b35a-c88b-47f6-b781-1fe56e518e9d tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /compute/v2.1/servers/b8269bb0-71ca-4269-ae95-6ccd9614cf1e" status: 200 len: 1265 microversion: 2.1 time: 0.223954 Dec 14 03:28:55.359625 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 676/1325] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:28:55 2021] GET /compute/v2.1/servers/b8269bb0-71ca-4269-ae95-6ccd9614cf1e => generated 1265 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:28:55.624494 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [req-d43bd7f7-2cf4-40b5-a778-ac4ddc11178a req-293d743b-4cfe-4e21-84dc-097fb4daf7da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8269bb0-71ca-4269-ae95-6ccd9614cf1e", "tag": "d552dc2f-b498-4237-8e44-bcc35ae08483"}]} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:28:55.632845 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:28:55.632845 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: warnings.warn(msg) Dec 14 03:28:55.641725 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [req-d43bd7f7-2cf4-40b5-a778-ac4ddc11178a req-293d743b-4cfe-4e21-84dc-097fb4daf7da service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:28:55.643074 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [req-d43bd7f7-2cf4-40b5-a778-ac4ddc11178a req-293d743b-4cfe-4e21-84dc-097fb4daf7da service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:28:55.660645 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.compute.server_external_events [req-d43bd7f7-2cf4-40b5-a778-ac4ddc11178a req-293d743b-4cfe-4e21-84dc-097fb4daf7da service nova] Creating event network-changed:d552dc2f-b498-4237-8e44-bcc35ae08483 for instance b8269bb0-71ca-4269-ae95-6ccd9614cf1e on hv-cinder-81803 Dec 14 03:28:55.667804 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [req-d43bd7f7-2cf4-40b5-a778-ac4ddc11178a req-293d743b-4cfe-4e21-84dc-097fb4daf7da service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049058 Dec 14 03:28:55.668726 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 650/1326] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Dec 14 03:28:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:28:56.376662 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-cbb3254b-8920-4fdb-894f-ba0102cc2ed8 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:28:56.377279 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-cbb3254b-8920-4fdb-894f-ba0102cc2ed8 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] [instance: b8269bb0-71ca-4269-ae95-6ccd9614cf1e] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:28:56.383657 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-cbb3254b-8920-4fdb-894f-ba0102cc2ed8 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:28:56.384104 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-cbb3254b-8920-4fdb-894f-ba0102cc2ed8 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:28:56.384880 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-cbb3254b-8920-4fdb-894f-ba0102cc2ed8 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:28:56.385311 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-cbb3254b-8920-4fdb-894f-ba0102cc2ed8 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:28:56.593476 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-cbb3254b-8920-4fdb-894f-ba0102cc2ed8 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf869873369f496e9e25a6d6b2a7ba86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:28:56.602146 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-cbb3254b-8920-4fdb-894f-ba0102cc2ed8 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /compute/v2.1/servers/b8269bb0-71ca-4269-ae95-6ccd9614cf1e" status: 200 len: 1265 microversion: 2.1 time: 0.229027 Dec 14 03:28:56.603198 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 677/1327] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:28:56 2021] GET /compute/v2.1/servers/b8269bb0-71ca-4269-ae95-6ccd9614cf1e => generated 1265 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:28:57.620053 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-ac757a34-a37b-4c38-ad37-925357572a13 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:28:57.620790 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-ac757a34-a37b-4c38-ad37-925357572a13 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] [instance: b8269bb0-71ca-4269-ae95-6ccd9614cf1e] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:28:57.627522 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ac757a34-a37b-4c38-ad37-925357572a13 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:28:57.627980 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ac757a34-a37b-4c38-ad37-925357572a13 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:28:57.628771 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ac757a34-a37b-4c38-ad37-925357572a13 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:28:57.629216 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-ac757a34-a37b-4c38-ad37-925357572a13 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:28:57.760514 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-ac757a34-a37b-4c38-ad37-925357572a13 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf869873369f496e9e25a6d6b2a7ba86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:28:57.768032 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-ac757a34-a37b-4c38-ad37-925357572a13 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /compute/v2.1/servers/b8269bb0-71ca-4269-ae95-6ccd9614cf1e" status: 200 len: 1265 microversion: 2.1 time: 0.152402 Dec 14 03:28:57.768587 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 651/1328] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:28:57 2021] GET /compute/v2.1/servers/b8269bb0-71ca-4269-ae95-6ccd9614cf1e => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:28:58.785302 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-68cee1f8-9e9a-461a-910c-501d75acd3ab tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:28:58.785922 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-68cee1f8-9e9a-461a-910c-501d75acd3ab tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] [instance: b8269bb0-71ca-4269-ae95-6ccd9614cf1e] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:28:58.792441 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-68cee1f8-9e9a-461a-910c-501d75acd3ab tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:28:58.792915 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-68cee1f8-9e9a-461a-910c-501d75acd3ab tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:28:58.793769 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-68cee1f8-9e9a-461a-910c-501d75acd3ab tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:28:58.794196 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-68cee1f8-9e9a-461a-910c-501d75acd3ab tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:28:58.934790 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-68cee1f8-9e9a-461a-910c-501d75acd3ab tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf869873369f496e9e25a6d6b2a7ba86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:28:58.942124 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-68cee1f8-9e9a-461a-910c-501d75acd3ab tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /compute/v2.1/servers/b8269bb0-71ca-4269-ae95-6ccd9614cf1e" status: 200 len: 1265 microversion: 2.1 time: 0.160491 Dec 14 03:28:58.942681 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 678/1329] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:28:58 2021] GET /compute/v2.1/servers/b8269bb0-71ca-4269-ae95-6ccd9614cf1e => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:28:59.957996 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-94dd71c2-2384-4a5f-b0ee-b7a54f0b8469 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:28:59.958540 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-94dd71c2-2384-4a5f-b0ee-b7a54f0b8469 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] [instance: b8269bb0-71ca-4269-ae95-6ccd9614cf1e] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:28:59.964386 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-94dd71c2-2384-4a5f-b0ee-b7a54f0b8469 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:28:59.964839 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-94dd71c2-2384-4a5f-b0ee-b7a54f0b8469 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:28:59.965617 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-94dd71c2-2384-4a5f-b0ee-b7a54f0b8469 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:28:59.966057 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-94dd71c2-2384-4a5f-b0ee-b7a54f0b8469 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:29:00.092589 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-94dd71c2-2384-4a5f-b0ee-b7a54f0b8469 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf869873369f496e9e25a6d6b2a7ba86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:29:00.099800 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-94dd71c2-2384-4a5f-b0ee-b7a54f0b8469 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /compute/v2.1/servers/b8269bb0-71ca-4269-ae95-6ccd9614cf1e" status: 200 len: 1265 microversion: 2.1 time: 0.145690 Dec 14 03:29:00.100355 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 652/1330] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:28:59 2021] GET /compute/v2.1/servers/b8269bb0-71ca-4269-ae95-6ccd9614cf1e => generated 1265 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:29:01.117191 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-70b37657-d54e-4fdf-b25e-146961f52408 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:29:01.117806 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-70b37657-d54e-4fdf-b25e-146961f52408 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] [instance: b8269bb0-71ca-4269-ae95-6ccd9614cf1e] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:29:01.124739 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-70b37657-d54e-4fdf-b25e-146961f52408 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:29:01.125213 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-70b37657-d54e-4fdf-b25e-146961f52408 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:29:01.125987 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-70b37657-d54e-4fdf-b25e-146961f52408 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:29:01.126420 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-70b37657-d54e-4fdf-b25e-146961f52408 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:29:01.258125 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-70b37657-d54e-4fdf-b25e-146961f52408 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf869873369f496e9e25a6d6b2a7ba86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:29:01.265345 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-70b37657-d54e-4fdf-b25e-146961f52408 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /compute/v2.1/servers/b8269bb0-71ca-4269-ae95-6ccd9614cf1e" status: 200 len: 1265 microversion: 2.1 time: 0.152004 Dec 14 03:29:01.265908 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 679/1331] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:29:01 2021] GET /compute/v2.1/servers/b8269bb0-71ca-4269-ae95-6ccd9614cf1e => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:29:02.281914 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-75e8791b-ee38-4aec-82b0-327f51d239bb tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:29:02.282529 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-75e8791b-ee38-4aec-82b0-327f51d239bb tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] [instance: b8269bb0-71ca-4269-ae95-6ccd9614cf1e] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:29:02.288916 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-75e8791b-ee38-4aec-82b0-327f51d239bb tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:29:02.289369 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-75e8791b-ee38-4aec-82b0-327f51d239bb tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:29:02.290152 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-75e8791b-ee38-4aec-82b0-327f51d239bb tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:29:02.290589 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-75e8791b-ee38-4aec-82b0-327f51d239bb tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:29:02.417539 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-75e8791b-ee38-4aec-82b0-327f51d239bb tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf869873369f496e9e25a6d6b2a7ba86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:29:02.425363 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-75e8791b-ee38-4aec-82b0-327f51d239bb tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /compute/v2.1/servers/b8269bb0-71ca-4269-ae95-6ccd9614cf1e" status: 200 len: 1265 microversion: 2.1 time: 0.147129 Dec 14 03:29:02.425947 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 653/1332] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:29:02 2021] GET /compute/v2.1/servers/b8269bb0-71ca-4269-ae95-6ccd9614cf1e => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:29:03.441437 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-63b6c48e-585e-47e7-8177-b49318380f0d tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:29:03.442044 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-63b6c48e-585e-47e7-8177-b49318380f0d tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] [instance: b8269bb0-71ca-4269-ae95-6ccd9614cf1e] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:29:03.448384 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-63b6c48e-585e-47e7-8177-b49318380f0d tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:29:03.448826 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-63b6c48e-585e-47e7-8177-b49318380f0d tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:29:03.449598 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-63b6c48e-585e-47e7-8177-b49318380f0d tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:29:03.450027 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-63b6c48e-585e-47e7-8177-b49318380f0d tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:29:03.575304 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-63b6c48e-585e-47e7-8177-b49318380f0d tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf869873369f496e9e25a6d6b2a7ba86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:29:03.582381 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-63b6c48e-585e-47e7-8177-b49318380f0d tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /compute/v2.1/servers/b8269bb0-71ca-4269-ae95-6ccd9614cf1e" status: 200 len: 1265 microversion: 2.1 time: 0.144562 Dec 14 03:29:03.582941 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 680/1333] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:29:03 2021] GET /compute/v2.1/servers/b8269bb0-71ca-4269-ae95-6ccd9614cf1e => generated 1265 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:29:04.598873 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-e2d0cf67-d527-4d7c-8c99-08f73c065f08 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:29:04.599496 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-e2d0cf67-d527-4d7c-8c99-08f73c065f08 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] [instance: b8269bb0-71ca-4269-ae95-6ccd9614cf1e] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:29:04.606515 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-e2d0cf67-d527-4d7c-8c99-08f73c065f08 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:29:04.606966 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-e2d0cf67-d527-4d7c-8c99-08f73c065f08 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:29:04.607771 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-e2d0cf67-d527-4d7c-8c99-08f73c065f08 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:29:04.608209 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-e2d0cf67-d527-4d7c-8c99-08f73c065f08 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:29:04.738736 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-e2d0cf67-d527-4d7c-8c99-08f73c065f08 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf869873369f496e9e25a6d6b2a7ba86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:29:04.745859 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-e2d0cf67-d527-4d7c-8c99-08f73c065f08 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /compute/v2.1/servers/b8269bb0-71ca-4269-ae95-6ccd9614cf1e" status: 200 len: 1265 microversion: 2.1 time: 0.150656 Dec 14 03:29:04.746407 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 654/1334] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:29:04 2021] GET /compute/v2.1/servers/b8269bb0-71ca-4269-ae95-6ccd9614cf1e => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:29:05.762213 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-5c460470-92d8-4194-a972-03e6259c0f88 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:29:05.762828 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-5c460470-92d8-4194-a972-03e6259c0f88 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] [instance: b8269bb0-71ca-4269-ae95-6ccd9614cf1e] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:29:05.769205 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5c460470-92d8-4194-a972-03e6259c0f88 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:29:05.769653 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5c460470-92d8-4194-a972-03e6259c0f88 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:29:05.770426 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5c460470-92d8-4194-a972-03e6259c0f88 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:29:05.770863 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5c460470-92d8-4194-a972-03e6259c0f88 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:29:05.896932 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-5c460470-92d8-4194-a972-03e6259c0f88 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf869873369f496e9e25a6d6b2a7ba86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:29:05.905449 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-5c460470-92d8-4194-a972-03e6259c0f88 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /compute/v2.1/servers/b8269bb0-71ca-4269-ae95-6ccd9614cf1e" status: 200 len: 1265 microversion: 2.1 time: 0.146744 Dec 14 03:29:05.905901 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 681/1335] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:29:05 2021] GET /compute/v2.1/servers/b8269bb0-71ca-4269-ae95-6ccd9614cf1e => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:29:06.921418 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-96c73830-bf68-4313-abfc-a154fce293a9 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:29:06.922061 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-96c73830-bf68-4313-abfc-a154fce293a9 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] [instance: b8269bb0-71ca-4269-ae95-6ccd9614cf1e] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:29:06.928249 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-96c73830-bf68-4313-abfc-a154fce293a9 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:29:06.928699 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-96c73830-bf68-4313-abfc-a154fce293a9 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:29:06.929473 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-96c73830-bf68-4313-abfc-a154fce293a9 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:29:06.929908 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-96c73830-bf68-4313-abfc-a154fce293a9 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:29:07.059527 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-96c73830-bf68-4313-abfc-a154fce293a9 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf869873369f496e9e25a6d6b2a7ba86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:29:07.066803 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-96c73830-bf68-4313-abfc-a154fce293a9 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /compute/v2.1/servers/b8269bb0-71ca-4269-ae95-6ccd9614cf1e" status: 200 len: 1265 microversion: 2.1 time: 0.148993 Dec 14 03:29:07.067438 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 655/1336] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:29:06 2021] GET /compute/v2.1/servers/b8269bb0-71ca-4269-ae95-6ccd9614cf1e => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:29:08.065699 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [req-f768b900-5d1d-41c9-b399-27807f0ec359 req-1b89b0ed-ab29-493f-bc62-ecb0c5cd2e62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8269bb0-71ca-4269-ae95-6ccd9614cf1e", "name": "network-vif-plugged", "status": "completed", "tag": "d552dc2f-b498-4237-8e44-bcc35ae08483"}]} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:29:08.067222 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:29:08.067222 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: warnings.warn(msg) Dec 14 03:29:08.075310 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-f768b900-5d1d-41c9-b399-27807f0ec359 req-1b89b0ed-ab29-493f-bc62-ecb0c5cd2e62 service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:29:08.075756 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-f768b900-5d1d-41c9-b399-27807f0ec359 req-1b89b0ed-ab29-493f-bc62-ecb0c5cd2e62 service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:29:08.084008 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-586f9d55-a725-4928-b2ed-62e96e96e512 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:29:08.084684 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-586f9d55-a725-4928-b2ed-62e96e96e512 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] [instance: b8269bb0-71ca-4269-ae95-6ccd9614cf1e] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:29:08.086863 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.compute.server_external_events [req-f768b900-5d1d-41c9-b399-27807f0ec359 req-1b89b0ed-ab29-493f-bc62-ecb0c5cd2e62 service nova] Creating event network-vif-plugged:d552dc2f-b498-4237-8e44-bcc35ae08483 for instance b8269bb0-71ca-4269-ae95-6ccd9614cf1e on hv-cinder-81803 Dec 14 03:29:08.092522 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-586f9d55-a725-4928-b2ed-62e96e96e512 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:29:08.092802 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [req-f768b900-5d1d-41c9-b399-27807f0ec359 req-1b89b0ed-ab29-493f-bc62-ecb0c5cd2e62 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030667 Dec 14 03:29:08.092988 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-586f9d55-a725-4928-b2ed-62e96e96e512 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:29:08.093728 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 682/1337] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Dec 14 03:29:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:29:08.094065 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-586f9d55-a725-4928-b2ed-62e96e96e512 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:29:08.094508 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-586f9d55-a725-4928-b2ed-62e96e96e512 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:29:08.223283 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-586f9d55-a725-4928-b2ed-62e96e96e512 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf869873369f496e9e25a6d6b2a7ba86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:29:08.230617 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-586f9d55-a725-4928-b2ed-62e96e96e512 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /compute/v2.1/servers/b8269bb0-71ca-4269-ae95-6ccd9614cf1e" status: 200 len: 1265 microversion: 2.1 time: 0.150325 Dec 14 03:29:08.231209 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 656/1338] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:29:08 2021] GET /compute/v2.1/servers/b8269bb0-71ca-4269-ae95-6ccd9614cf1e => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:29:09.248455 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-4ad3a016-97bf-4441-b68e-ff17c1101cdb tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:29:09.249168 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-4ad3a016-97bf-4441-b68e-ff17c1101cdb tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] [instance: b8269bb0-71ca-4269-ae95-6ccd9614cf1e] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:29:09.255475 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4ad3a016-97bf-4441-b68e-ff17c1101cdb tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:29:09.255935 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4ad3a016-97bf-4441-b68e-ff17c1101cdb tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:29:09.256715 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4ad3a016-97bf-4441-b68e-ff17c1101cdb tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:29:09.257154 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4ad3a016-97bf-4441-b68e-ff17c1101cdb tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:29:09.384543 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-4ad3a016-97bf-4441-b68e-ff17c1101cdb tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf869873369f496e9e25a6d6b2a7ba86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:29:09.391842 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-4ad3a016-97bf-4441-b68e-ff17c1101cdb tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /compute/v2.1/servers/b8269bb0-71ca-4269-ae95-6ccd9614cf1e" status: 200 len: 1265 microversion: 2.1 time: 0.147877 Dec 14 03:29:09.392409 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 683/1339] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:29:09 2021] GET /compute/v2.1/servers/b8269bb0-71ca-4269-ae95-6ccd9614cf1e => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:29:10.408723 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-1456bc05-4378-422c-9986-e26f818682b8 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:29:10.409320 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-1456bc05-4378-422c-9986-e26f818682b8 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] [instance: b8269bb0-71ca-4269-ae95-6ccd9614cf1e] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:29:10.415552 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-1456bc05-4378-422c-9986-e26f818682b8 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:29:10.415998 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-1456bc05-4378-422c-9986-e26f818682b8 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:29:10.416768 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-1456bc05-4378-422c-9986-e26f818682b8 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:29:10.417202 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-1456bc05-4378-422c-9986-e26f818682b8 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:29:10.544614 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-1456bc05-4378-422c-9986-e26f818682b8 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf869873369f496e9e25a6d6b2a7ba86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:29:10.551777 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-1456bc05-4378-422c-9986-e26f818682b8 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /compute/v2.1/servers/b8269bb0-71ca-4269-ae95-6ccd9614cf1e" status: 200 len: 1453 microversion: 2.1 time: 0.146764 Dec 14 03:29:10.552334 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 657/1340] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:29:10 2021] GET /compute/v2.1/servers/b8269bb0-71ca-4269-ae95-6ccd9614cf1e => generated 1453 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:29:10.567963 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-97870b6f-e17b-4291-b975-f272ab36d3c6 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:29:10.568578 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-97870b6f-e17b-4291-b975-f272ab36d3c6 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] [instance: b8269bb0-71ca-4269-ae95-6ccd9614cf1e] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:29:10.574713 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-97870b6f-e17b-4291-b975-f272ab36d3c6 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:29:10.575204 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-97870b6f-e17b-4291-b975-f272ab36d3c6 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:29:10.575987 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-97870b6f-e17b-4291-b975-f272ab36d3c6 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:29:10.576426 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-97870b6f-e17b-4291-b975-f272ab36d3c6 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:29:10.706502 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-97870b6f-e17b-4291-b975-f272ab36d3c6 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf869873369f496e9e25a6d6b2a7ba86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:29:10.713711 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-97870b6f-e17b-4291-b975-f272ab36d3c6 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /compute/v2.1/servers/b8269bb0-71ca-4269-ae95-6ccd9614cf1e" status: 200 len: 1453 microversion: 2.1 time: 0.149398 Dec 14 03:29:10.714260 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 684/1341] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:29:10 2021] GET /compute/v2.1/servers/b8269bb0-71ca-4269-ae95-6ccd9614cf1e => generated 1453 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:29:12.600198 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [req-65d526bd-891f-419e-b994-3fa8641a39c5 req-bf1425f4-92f1-4ee8-8c74-9e937e6194d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8269bb0-71ca-4269-ae95-6ccd9614cf1e", "tag": "d552dc2f-b498-4237-8e44-bcc35ae08483"}]} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:29:12.601740 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:29:12.601740 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: warnings.warn(msg) Dec 14 03:29:12.608573 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [req-65d526bd-891f-419e-b994-3fa8641a39c5 req-bf1425f4-92f1-4ee8-8c74-9e937e6194d9 service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:29:12.608882 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [req-65d526bd-891f-419e-b994-3fa8641a39c5 req-bf1425f4-92f1-4ee8-8c74-9e937e6194d9 service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:29:12.620199 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.compute.server_external_events [req-65d526bd-891f-419e-b994-3fa8641a39c5 req-bf1425f4-92f1-4ee8-8c74-9e937e6194d9 service nova] Creating event network-changed:d552dc2f-b498-4237-8e44-bcc35ae08483 for instance b8269bb0-71ca-4269-ae95-6ccd9614cf1e on hv-cinder-81803 Dec 14 03:29:12.625248 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [req-65d526bd-891f-419e-b994-3fa8641a39c5 req-bf1425f4-92f1-4ee8-8c74-9e937e6194d9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030453 Dec 14 03:29:12.625836 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 658/1342] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Dec 14 03:29:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:29:35.344868 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 14 03:29:35.345436 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: Tue Dec 14 03:29:35 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 14 03:30:22.922795 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 14 03:30:22.923503 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: Tue Dec 14 03:30:22 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 14 03:30:42.860950 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-e3fe1d4d-5890-4b7d-86e7-5ae9b2f0ea7a tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:30:42.861563 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-e3fe1d4d-5890-4b7d-86e7-5ae9b2f0ea7a tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] [instance: ebdfbba3-0077-46f6-af60-35f085357682] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:30:42.867611 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e3fe1d4d-5890-4b7d-86e7-5ae9b2f0ea7a tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:30:42.868056 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e3fe1d4d-5890-4b7d-86e7-5ae9b2f0ea7a tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:30:42.868819 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e3fe1d4d-5890-4b7d-86e7-5ae9b2f0ea7a tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:30:42.869753 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e3fe1d4d-5890-4b7d-86e7-5ae9b2f0ea7a tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:30:42.892086 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.objects.instance [None req-e3fe1d4d-5890-4b7d-86e7-5ae9b2f0ea7a tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lazy-loading 'flavor' on Instance uuid ebdfbba3-0077-46f6-af60-35f085357682 {{(pid=116072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 14 03:30:42.960153 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-e3fe1d4d-5890-4b7d-86e7-5ae9b2f0ea7a tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "POST /compute/v2.1/servers/ebdfbba3-0077-46f6-af60-35f085357682/action" status: 202 len: 0 microversion: 2.1 time: 0.103472 Dec 14 03:30:42.960662 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 685/1343] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:30:42 2021] POST /compute/v2.1/servers/ebdfbba3-0077-46f6-af60-35f085357682/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:30:42.970301 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-a99e778c-6011-4f6a-8208-f83aec88b6c9 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:30:42.971009 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-a99e778c-6011-4f6a-8208-f83aec88b6c9 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] [instance: ebdfbba3-0077-46f6-af60-35f085357682] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:30:42.977177 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a99e778c-6011-4f6a-8208-f83aec88b6c9 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:30:42.977632 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a99e778c-6011-4f6a-8208-f83aec88b6c9 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:30:42.978416 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a99e778c-6011-4f6a-8208-f83aec88b6c9 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:30:42.978853 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a99e778c-6011-4f6a-8208-f83aec88b6c9 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:30:43.190708 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-a99e778c-6011-4f6a-8208-f83aec88b6c9 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82d0b9a044e43fba9a353b54b74c680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:30:43.198029 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-a99e778c-6011-4f6a-8208-f83aec88b6c9 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /compute/v2.1/servers/ebdfbba3-0077-46f6-af60-35f085357682" status: 200 len: 1568 microversion: 2.1 time: 0.232981 Dec 14 03:30:43.198586 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 659/1344] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:30:42 2021] GET /compute/v2.1/servers/ebdfbba3-0077-46f6-af60-35f085357682 => generated 1568 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:30:44.216541 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-ff990954-62c0-40dd-ba7e-65876c74f206 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:30:44.217212 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-ff990954-62c0-40dd-ba7e-65876c74f206 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] [instance: ebdfbba3-0077-46f6-af60-35f085357682] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:30:44.223311 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ff990954-62c0-40dd-ba7e-65876c74f206 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:30:44.223761 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ff990954-62c0-40dd-ba7e-65876c74f206 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:30:44.224531 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ff990954-62c0-40dd-ba7e-65876c74f206 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:30:44.224965 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ff990954-62c0-40dd-ba7e-65876c74f206 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:30:44.401845 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-ff990954-62c0-40dd-ba7e-65876c74f206 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82d0b9a044e43fba9a353b54b74c680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:30:44.409001 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-ff990954-62c0-40dd-ba7e-65876c74f206 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /compute/v2.1/servers/ebdfbba3-0077-46f6-af60-35f085357682" status: 200 len: 1568 microversion: 2.1 time: 0.197138 Dec 14 03:30:44.409554 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 686/1345] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:30:44 2021] GET /compute/v2.1/servers/ebdfbba3-0077-46f6-af60-35f085357682 => generated 1568 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:30:45.426695 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-aadefaa5-f2f8-4556-a339-b3db5863a139 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:30:45.427331 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-aadefaa5-f2f8-4556-a339-b3db5863a139 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] [instance: ebdfbba3-0077-46f6-af60-35f085357682] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:30:45.434205 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-aadefaa5-f2f8-4556-a339-b3db5863a139 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:30:45.434650 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-aadefaa5-f2f8-4556-a339-b3db5863a139 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:30:45.435455 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-aadefaa5-f2f8-4556-a339-b3db5863a139 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:30:45.435973 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-aadefaa5-f2f8-4556-a339-b3db5863a139 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:30:45.562449 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-aadefaa5-f2f8-4556-a339-b3db5863a139 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82d0b9a044e43fba9a353b54b74c680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:30:45.569636 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-aadefaa5-f2f8-4556-a339-b3db5863a139 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /compute/v2.1/servers/ebdfbba3-0077-46f6-af60-35f085357682" status: 200 len: 1568 microversion: 2.1 time: 0.146615 Dec 14 03:30:45.570181 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 660/1346] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:30:45 2021] GET /compute/v2.1/servers/ebdfbba3-0077-46f6-af60-35f085357682 => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:30:46.586542 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-44fe80c9-701f-4dd1-82d7-a4fdfefc25db tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:30:46.587192 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-44fe80c9-701f-4dd1-82d7-a4fdfefc25db tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] [instance: ebdfbba3-0077-46f6-af60-35f085357682] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:30:46.593936 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-44fe80c9-701f-4dd1-82d7-a4fdfefc25db tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:30:46.594385 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-44fe80c9-701f-4dd1-82d7-a4fdfefc25db tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:30:46.595211 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-44fe80c9-701f-4dd1-82d7-a4fdfefc25db tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:30:46.595663 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-44fe80c9-701f-4dd1-82d7-a4fdfefc25db tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:30:46.727875 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-44fe80c9-701f-4dd1-82d7-a4fdfefc25db tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82d0b9a044e43fba9a353b54b74c680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:30:46.735678 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-44fe80c9-701f-4dd1-82d7-a4fdfefc25db tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /compute/v2.1/servers/ebdfbba3-0077-46f6-af60-35f085357682" status: 200 len: 1568 microversion: 2.1 time: 0.152753 Dec 14 03:30:46.736234 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 687/1347] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:30:46 2021] GET /compute/v2.1/servers/ebdfbba3-0077-46f6-af60-35f085357682 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:30:47.752772 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-94f609c4-2d6e-4114-883a-19d64fcb5fd2 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:30:47.753383 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-94f609c4-2d6e-4114-883a-19d64fcb5fd2 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] [instance: ebdfbba3-0077-46f6-af60-35f085357682] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:30:47.760343 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-94f609c4-2d6e-4114-883a-19d64fcb5fd2 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:30:47.760802 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-94f609c4-2d6e-4114-883a-19d64fcb5fd2 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:30:47.761585 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-94f609c4-2d6e-4114-883a-19d64fcb5fd2 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:30:47.762028 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-94f609c4-2d6e-4114-883a-19d64fcb5fd2 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:30:47.899813 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-94f609c4-2d6e-4114-883a-19d64fcb5fd2 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82d0b9a044e43fba9a353b54b74c680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:30:47.908113 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-94f609c4-2d6e-4114-883a-19d64fcb5fd2 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /compute/v2.1/servers/ebdfbba3-0077-46f6-af60-35f085357682" status: 200 len: 1568 microversion: 2.1 time: 0.159025 Dec 14 03:30:47.908662 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 661/1348] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:30:47 2021] GET /compute/v2.1/servers/ebdfbba3-0077-46f6-af60-35f085357682 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:30:48.925045 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-0d2b86a8-b02a-4e41-a239-1d0059f5a9e6 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:30:48.925603 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-0d2b86a8-b02a-4e41-a239-1d0059f5a9e6 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] [instance: ebdfbba3-0077-46f6-af60-35f085357682] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:30:48.931804 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0d2b86a8-b02a-4e41-a239-1d0059f5a9e6 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:30:48.932255 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0d2b86a8-b02a-4e41-a239-1d0059f5a9e6 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:30:48.933023 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0d2b86a8-b02a-4e41-a239-1d0059f5a9e6 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:30:48.933459 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0d2b86a8-b02a-4e41-a239-1d0059f5a9e6 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:30:49.062460 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-0d2b86a8-b02a-4e41-a239-1d0059f5a9e6 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82d0b9a044e43fba9a353b54b74c680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:30:49.069661 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-0d2b86a8-b02a-4e41-a239-1d0059f5a9e6 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /compute/v2.1/servers/ebdfbba3-0077-46f6-af60-35f085357682" status: 200 len: 1568 microversion: 2.1 time: 0.148313 Dec 14 03:30:49.070216 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 688/1349] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:30:48 2021] GET /compute/v2.1/servers/ebdfbba3-0077-46f6-af60-35f085357682 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:30:50.086713 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-5d3e1159-a6f8-4b41-8d6c-4a12763a4fdc tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:30:50.087359 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-5d3e1159-a6f8-4b41-8d6c-4a12763a4fdc tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] [instance: ebdfbba3-0077-46f6-af60-35f085357682] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:30:50.093761 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-5d3e1159-a6f8-4b41-8d6c-4a12763a4fdc tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:30:50.094207 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-5d3e1159-a6f8-4b41-8d6c-4a12763a4fdc tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:30:50.095024 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-5d3e1159-a6f8-4b41-8d6c-4a12763a4fdc tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:30:50.095482 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-5d3e1159-a6f8-4b41-8d6c-4a12763a4fdc tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:30:50.224366 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-5d3e1159-a6f8-4b41-8d6c-4a12763a4fdc tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82d0b9a044e43fba9a353b54b74c680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:30:50.232098 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-5d3e1159-a6f8-4b41-8d6c-4a12763a4fdc tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /compute/v2.1/servers/ebdfbba3-0077-46f6-af60-35f085357682" status: 200 len: 1568 microversion: 2.1 time: 0.149072 Dec 14 03:30:50.232651 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 662/1350] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:30:50 2021] GET /compute/v2.1/servers/ebdfbba3-0077-46f6-af60-35f085357682 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:30:51.248750 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-3308a274-4917-4e62-8c0d-d55aebd44499 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:30:51.249363 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-3308a274-4917-4e62-8c0d-d55aebd44499 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] [instance: ebdfbba3-0077-46f6-af60-35f085357682] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:30:51.255414 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3308a274-4917-4e62-8c0d-d55aebd44499 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:30:51.255869 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3308a274-4917-4e62-8c0d-d55aebd44499 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:30:51.256649 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3308a274-4917-4e62-8c0d-d55aebd44499 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:30:51.257087 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3308a274-4917-4e62-8c0d-d55aebd44499 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:30:51.419753 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-3308a274-4917-4e62-8c0d-d55aebd44499 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82d0b9a044e43fba9a353b54b74c680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:30:51.429601 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-3308a274-4917-4e62-8c0d-d55aebd44499 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /compute/v2.1/servers/ebdfbba3-0077-46f6-af60-35f085357682" status: 200 len: 1568 microversion: 2.1 time: 0.183456 Dec 14 03:30:51.430200 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 689/1351] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:30:51 2021] GET /compute/v2.1/servers/ebdfbba3-0077-46f6-af60-35f085357682 => generated 1568 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:30:52.447680 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-b0aaea7d-d60c-4614-838f-d16071811880 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:30:52.448320 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-b0aaea7d-d60c-4614-838f-d16071811880 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] [instance: ebdfbba3-0077-46f6-af60-35f085357682] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:30:52.454596 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b0aaea7d-d60c-4614-838f-d16071811880 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:30:52.455075 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b0aaea7d-d60c-4614-838f-d16071811880 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:30:52.455861 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b0aaea7d-d60c-4614-838f-d16071811880 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:30:52.456296 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-b0aaea7d-d60c-4614-838f-d16071811880 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:30:52.583420 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-b0aaea7d-d60c-4614-838f-d16071811880 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82d0b9a044e43fba9a353b54b74c680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:30:52.591194 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-b0aaea7d-d60c-4614-838f-d16071811880 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /compute/v2.1/servers/ebdfbba3-0077-46f6-af60-35f085357682" status: 200 len: 1568 microversion: 2.1 time: 0.147157 Dec 14 03:30:52.591764 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 663/1352] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:30:52 2021] GET /compute/v2.1/servers/ebdfbba3-0077-46f6-af60-35f085357682 => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:30:53.609201 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-70905f97-ec54-4261-b375-5f46a652ec92 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:30:53.609812 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-70905f97-ec54-4261-b375-5f46a652ec92 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] [instance: ebdfbba3-0077-46f6-af60-35f085357682] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:30:53.616387 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-70905f97-ec54-4261-b375-5f46a652ec92 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:30:53.616848 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-70905f97-ec54-4261-b375-5f46a652ec92 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:30:53.617621 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-70905f97-ec54-4261-b375-5f46a652ec92 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:30:53.618060 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-70905f97-ec54-4261-b375-5f46a652ec92 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:30:54.045955 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-70905f97-ec54-4261-b375-5f46a652ec92 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82d0b9a044e43fba9a353b54b74c680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:30:54.053349 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-70905f97-ec54-4261-b375-5f46a652ec92 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /compute/v2.1/servers/ebdfbba3-0077-46f6-af60-35f085357682" status: 200 len: 1568 microversion: 2.1 time: 0.447790 Dec 14 03:30:54.054194 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 690/1353] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:30:53 2021] GET /compute/v2.1/servers/ebdfbba3-0077-46f6-af60-35f085357682 => generated 1568 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:30:55.071224 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-2cd97f27-fbe4-4938-806e-c167d5bf34cc tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:30:55.071869 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-2cd97f27-fbe4-4938-806e-c167d5bf34cc tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] [instance: ebdfbba3-0077-46f6-af60-35f085357682] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:30:55.078716 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-2cd97f27-fbe4-4938-806e-c167d5bf34cc tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:30:55.079198 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-2cd97f27-fbe4-4938-806e-c167d5bf34cc tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:30:55.079965 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-2cd97f27-fbe4-4938-806e-c167d5bf34cc tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:30:55.080400 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-2cd97f27-fbe4-4938-806e-c167d5bf34cc tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:30:55.210037 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-2cd97f27-fbe4-4938-806e-c167d5bf34cc tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82d0b9a044e43fba9a353b54b74c680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:30:55.217488 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-2cd97f27-fbe4-4938-806e-c167d5bf34cc tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /compute/v2.1/servers/ebdfbba3-0077-46f6-af60-35f085357682" status: 200 len: 1568 microversion: 2.1 time: 0.149834 Dec 14 03:30:55.218252 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 664/1354] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:30:55 2021] GET /compute/v2.1/servers/ebdfbba3-0077-46f6-af60-35f085357682 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:30:56.234822 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-86c6793d-ce61-48f3-b85b-c949b4f5ecbe tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:30:56.235457 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-86c6793d-ce61-48f3-b85b-c949b4f5ecbe tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] [instance: ebdfbba3-0077-46f6-af60-35f085357682] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:30:56.241907 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-86c6793d-ce61-48f3-b85b-c949b4f5ecbe tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:30:56.242351 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-86c6793d-ce61-48f3-b85b-c949b4f5ecbe tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:30:56.243157 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-86c6793d-ce61-48f3-b85b-c949b4f5ecbe tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:30:56.243590 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-86c6793d-ce61-48f3-b85b-c949b4f5ecbe tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:30:56.376208 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-86c6793d-ce61-48f3-b85b-c949b4f5ecbe tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82d0b9a044e43fba9a353b54b74c680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:30:56.383594 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-86c6793d-ce61-48f3-b85b-c949b4f5ecbe tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /compute/v2.1/servers/ebdfbba3-0077-46f6-af60-35f085357682" status: 200 len: 1568 microversion: 2.1 time: 0.153319 Dec 14 03:30:56.384148 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 691/1355] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:30:56 2021] GET /compute/v2.1/servers/ebdfbba3-0077-46f6-af60-35f085357682 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:30:57.401733 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-c8fbce58-58f9-4867-9cf4-12f646f9809b tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:30:57.402341 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-c8fbce58-58f9-4867-9cf4-12f646f9809b tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] [instance: ebdfbba3-0077-46f6-af60-35f085357682] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:30:57.408541 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c8fbce58-58f9-4867-9cf4-12f646f9809b tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:30:57.409014 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c8fbce58-58f9-4867-9cf4-12f646f9809b tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:30:57.409780 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c8fbce58-58f9-4867-9cf4-12f646f9809b tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:30:57.410215 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c8fbce58-58f9-4867-9cf4-12f646f9809b tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:30:57.539559 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-c8fbce58-58f9-4867-9cf4-12f646f9809b tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82d0b9a044e43fba9a353b54b74c680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:30:57.546745 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-c8fbce58-58f9-4867-9cf4-12f646f9809b tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /compute/v2.1/servers/ebdfbba3-0077-46f6-af60-35f085357682" status: 200 len: 1509 microversion: 2.1 time: 0.149251 Dec 14 03:30:57.547342 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 665/1356] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:30:57 2021] GET /compute/v2.1/servers/ebdfbba3-0077-46f6-af60-35f085357682 => generated 1509 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 03:30:57.562699 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-cf33080a-f6c8-40ae-83c0-c9fc3ed7f8be tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:30:57.563454 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-cf33080a-f6c8-40ae-83c0-c9fc3ed7f8be tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] [instance: ebdfbba3-0077-46f6-af60-35f085357682] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:30:57.569455 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-cf33080a-f6c8-40ae-83c0-c9fc3ed7f8be tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:30:57.569921 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-cf33080a-f6c8-40ae-83c0-c9fc3ed7f8be tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:30:57.570706 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-cf33080a-f6c8-40ae-83c0-c9fc3ed7f8be tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:30:57.571211 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-cf33080a-f6c8-40ae-83c0-c9fc3ed7f8be tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:30:57.644645 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-cf33080a-f6c8-40ae-83c0-c9fc3ed7f8be tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "POST /compute/v2.1/servers/ebdfbba3-0077-46f6-af60-35f085357682/action" status: 202 len: 0 microversion: 2.1 time: 0.085505 Dec 14 03:30:57.645263 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 692/1357] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Dec 14 03:30:57 2021] POST /compute/v2.1/servers/ebdfbba3-0077-46f6-af60-35f085357682/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:30:57.653794 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-a8b507f0-f67f-401e-866f-3b09e8255395 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:30:57.654399 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-a8b507f0-f67f-401e-866f-3b09e8255395 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] [instance: ebdfbba3-0077-46f6-af60-35f085357682] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:30:57.661109 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a8b507f0-f67f-401e-866f-3b09e8255395 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:30:57.661562 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a8b507f0-f67f-401e-866f-3b09e8255395 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:30:57.662396 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a8b507f0-f67f-401e-866f-3b09e8255395 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:30:57.662883 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a8b507f0-f67f-401e-866f-3b09e8255395 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:30:57.794875 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-a8b507f0-f67f-401e-866f-3b09e8255395 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82d0b9a044e43fba9a353b54b74c680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:30:57.802552 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-a8b507f0-f67f-401e-866f-3b09e8255395 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /compute/v2.1/servers/ebdfbba3-0077-46f6-af60-35f085357682" status: 200 len: 1517 microversion: 2.1 time: 0.153023 Dec 14 03:30:57.803135 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 666/1358] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:30:57 2021] GET /compute/v2.1/servers/ebdfbba3-0077-46f6-af60-35f085357682 => generated 1517 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:30:58.553237 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [req-66599f07-e106-4a63-b96e-90fdc55c05ad req-95d06f33-9121-43bb-9e86-18c5f8f35bc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebdfbba3-0077-46f6-af60-35f085357682", "name": "network-vif-unplugged", "status": "completed", "tag": "f5625fc9-aa99-4f98-9a5d-b0f54296bb68"}]} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:30:58.554804 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:30:58.554804 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: warnings.warn(msg) Dec 14 03:30:58.562599 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-66599f07-e106-4a63-b96e-90fdc55c05ad req-95d06f33-9121-43bb-9e86-18c5f8f35bc6 service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:30:58.563082 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-66599f07-e106-4a63-b96e-90fdc55c05ad req-95d06f33-9121-43bb-9e86-18c5f8f35bc6 service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:30:58.574677 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.compute.server_external_events [req-66599f07-e106-4a63-b96e-90fdc55c05ad req-95d06f33-9121-43bb-9e86-18c5f8f35bc6 service nova] Unable to find a host for instance ebdfbba3-0077-46f6-af60-35f085357682. Dropping event network-vif-unplugged {{(pid=116072) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Dec 14 03:30:58.575580 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [req-66599f07-e106-4a63-b96e-90fdc55c05ad req-95d06f33-9121-43bb-9e86-18c5f8f35bc6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026276 Dec 14 03:30:58.576162 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 693/1359] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Dec 14 03:30:58 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 27 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Dec 14 03:30:58.821663 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-93e34bf1-2b09-488b-b718-c2fcfd3dd2d0 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:30:58.823522 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-93e34bf1-2b09-488b-b718-c2fcfd3dd2d0 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] [instance: ebdfbba3-0077-46f6-af60-35f085357682] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:30:58.829635 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-93e34bf1-2b09-488b-b718-c2fcfd3dd2d0 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:30:58.830398 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-93e34bf1-2b09-488b-b718-c2fcfd3dd2d0 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:30:58.831309 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-93e34bf1-2b09-488b-b718-c2fcfd3dd2d0 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:30:58.831749 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-93e34bf1-2b09-488b-b718-c2fcfd3dd2d0 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:30:58.964508 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-93e34bf1-2b09-488b-b718-c2fcfd3dd2d0 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82d0b9a044e43fba9a353b54b74c680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:30:58.971705 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-93e34bf1-2b09-488b-b718-c2fcfd3dd2d0 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /compute/v2.1/servers/ebdfbba3-0077-46f6-af60-35f085357682" status: 200 len: 1519 microversion: 2.1 time: 0.154158 Dec 14 03:30:58.972257 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 667/1360] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:30:58 2021] GET /compute/v2.1/servers/ebdfbba3-0077-46f6-af60-35f085357682 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:30:59.989901 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-04cbc796-34bd-4eb5-9764-3d8d739ad164 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:30:59.990538 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-04cbc796-34bd-4eb5-9764-3d8d739ad164 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] [instance: ebdfbba3-0077-46f6-af60-35f085357682] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:30:59.997267 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-04cbc796-34bd-4eb5-9764-3d8d739ad164 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:30:59.997714 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-04cbc796-34bd-4eb5-9764-3d8d739ad164 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:30:59.998479 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-04cbc796-34bd-4eb5-9764-3d8d739ad164 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:30:59.998906 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-04cbc796-34bd-4eb5-9764-3d8d739ad164 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:31:00.125572 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-04cbc796-34bd-4eb5-9764-3d8d739ad164 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82d0b9a044e43fba9a353b54b74c680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:31:00.132769 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-04cbc796-34bd-4eb5-9764-3d8d739ad164 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /compute/v2.1/servers/ebdfbba3-0077-46f6-af60-35f085357682" status: 200 len: 1575 microversion: 2.1 time: 0.146822 Dec 14 03:31:00.133336 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 694/1361] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:30:59 2021] GET /compute/v2.1/servers/ebdfbba3-0077-46f6-af60-35f085357682 => generated 1575 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:31:01.149360 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-f3fafd7d-0844-4846-8d56-962748e635a4 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:31:01.150567 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-f3fafd7d-0844-4846-8d56-962748e635a4 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] [instance: ebdfbba3-0077-46f6-af60-35f085357682] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:31:01.156768 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-f3fafd7d-0844-4846-8d56-962748e635a4 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:31:01.157215 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-f3fafd7d-0844-4846-8d56-962748e635a4 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:31:01.157983 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-f3fafd7d-0844-4846-8d56-962748e635a4 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:31:01.158416 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-f3fafd7d-0844-4846-8d56-962748e635a4 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:31:01.285356 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-f3fafd7d-0844-4846-8d56-962748e635a4 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82d0b9a044e43fba9a353b54b74c680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:31:01.292571 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-f3fafd7d-0844-4846-8d56-962748e635a4 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /compute/v2.1/servers/ebdfbba3-0077-46f6-af60-35f085357682" status: 200 len: 1575 microversion: 2.1 time: 0.146849 Dec 14 03:31:01.293127 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 668/1362] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:31:01 2021] GET /compute/v2.1/servers/ebdfbba3-0077-46f6-af60-35f085357682 => generated 1575 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:31:02.309539 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-76f441bb-2e8c-45a4-8ecf-3d2cb2d3178e tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:31:02.310157 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-76f441bb-2e8c-45a4-8ecf-3d2cb2d3178e tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] [instance: ebdfbba3-0077-46f6-af60-35f085357682] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:31:02.316383 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-76f441bb-2e8c-45a4-8ecf-3d2cb2d3178e tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:31:02.316835 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-76f441bb-2e8c-45a4-8ecf-3d2cb2d3178e tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:31:02.317620 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-76f441bb-2e8c-45a4-8ecf-3d2cb2d3178e tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:31:02.318056 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-76f441bb-2e8c-45a4-8ecf-3d2cb2d3178e tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:31:02.449753 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-76f441bb-2e8c-45a4-8ecf-3d2cb2d3178e tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82d0b9a044e43fba9a353b54b74c680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:31:02.457154 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-76f441bb-2e8c-45a4-8ecf-3d2cb2d3178e tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /compute/v2.1/servers/ebdfbba3-0077-46f6-af60-35f085357682" status: 200 len: 1575 microversion: 2.1 time: 0.151296 Dec 14 03:31:02.457723 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 695/1363] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:31:02 2021] GET /compute/v2.1/servers/ebdfbba3-0077-46f6-af60-35f085357682 => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:31:02.892934 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-45b882ff-815d-4740-ad0a-d5756bf372d5 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:31:02.893462 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-45b882ff-815d-4740-ad0a-d5756bf372d5 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] [instance: b8269bb0-71ca-4269-ae95-6ccd9614cf1e] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:31:02.901112 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-45b882ff-815d-4740-ad0a-d5756bf372d5 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:31:02.901637 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-45b882ff-815d-4740-ad0a-d5756bf372d5 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:31:02.902516 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-45b882ff-815d-4740-ad0a-d5756bf372d5 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:31:02.903023 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-45b882ff-815d-4740-ad0a-d5756bf372d5 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:31:02.927916 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-45b882ff-815d-4740-ad0a-d5756bf372d5 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] [instance: b8269bb0-71ca-4269-ae95-6ccd9614cf1e] Going to try to terminate instance {{(pid=116071) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 14 03:31:02.959751 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [req-b655e9c8-fc65-41b5-b38f-a11212e4d6fb req-df35a84e-c8ad-4c20-a6e5-c7d6ff04cfcd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8269bb0-71ca-4269-ae95-6ccd9614cf1e", "tag": "d552dc2f-b498-4237-8e44-bcc35ae08483"}]} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:31:02.961286 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:31:02.961286 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: warnings.warn(msg) Dec 14 03:31:02.968915 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-b655e9c8-fc65-41b5-b38f-a11212e4d6fb req-df35a84e-c8ad-4c20-a6e5-c7d6ff04cfcd service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:31:02.969635 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-b655e9c8-fc65-41b5-b38f-a11212e4d6fb req-df35a84e-c8ad-4c20-a6e5-c7d6ff04cfcd service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:31:02.981946 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.compute.server_external_events [req-b655e9c8-fc65-41b5-b38f-a11212e4d6fb req-df35a84e-c8ad-4c20-a6e5-c7d6ff04cfcd service nova] Creating event network-changed:d552dc2f-b498-4237-8e44-bcc35ae08483 for instance b8269bb0-71ca-4269-ae95-6ccd9614cf1e on hv-cinder-81803 Dec 14 03:31:02.987519 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [req-b655e9c8-fc65-41b5-b38f-a11212e4d6fb req-df35a84e-c8ad-4c20-a6e5-c7d6ff04cfcd service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095545 Dec 14 03:31:02.988513 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 696/1364] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Dec 14 03:31:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:31:03.011455 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-45b882ff-815d-4740-ad0a-d5756bf372d5 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "DELETE /compute/v2.1/servers/b8269bb0-71ca-4269-ae95-6ccd9614cf1e" status: 204 len: 0 microversion: 2.1 time: 0.121920 Dec 14 03:31:03.012255 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 669/1365] 10.222.0.43 () {58 vars in 1238 bytes} [Tue Dec 14 03:31:02 2021] DELETE /compute/v2.1/servers/b8269bb0-71ca-4269-ae95-6ccd9614cf1e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 14 03:31:03.022129 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-d17918b1-ba8c-4019-b707-872449b8d0d6 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:31:03.022944 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-d17918b1-ba8c-4019-b707-872449b8d0d6 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] [instance: b8269bb0-71ca-4269-ae95-6ccd9614cf1e] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:31:03.030519 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d17918b1-ba8c-4019-b707-872449b8d0d6 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:31:03.031028 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d17918b1-ba8c-4019-b707-872449b8d0d6 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:31:03.031858 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d17918b1-ba8c-4019-b707-872449b8d0d6 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:31:03.032295 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d17918b1-ba8c-4019-b707-872449b8d0d6 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:31:03.275901 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-d17918b1-ba8c-4019-b707-872449b8d0d6 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf869873369f496e9e25a6d6b2a7ba86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:31:03.283698 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-d17918b1-ba8c-4019-b707-872449b8d0d6 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /compute/v2.1/servers/b8269bb0-71ca-4269-ae95-6ccd9614cf1e" status: 200 len: 1578 microversion: 2.1 time: 0.266978 Dec 14 03:31:03.284519 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 697/1366] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:31:03 2021] GET /compute/v2.1/servers/b8269bb0-71ca-4269-ae95-6ccd9614cf1e => generated 1578 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:31:03.475560 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-2fbc14da-d930-4f05-87d4-efdfcec8f56c tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:31:03.476263 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-2fbc14da-d930-4f05-87d4-efdfcec8f56c tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] [instance: ebdfbba3-0077-46f6-af60-35f085357682] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:31:03.481985 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-2fbc14da-d930-4f05-87d4-efdfcec8f56c tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:31:03.482435 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-2fbc14da-d930-4f05-87d4-efdfcec8f56c tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:31:03.483248 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-2fbc14da-d930-4f05-87d4-efdfcec8f56c tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:31:03.483876 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-2fbc14da-d930-4f05-87d4-efdfcec8f56c tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:31:03.687618 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-2fbc14da-d930-4f05-87d4-efdfcec8f56c tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82d0b9a044e43fba9a353b54b74c680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:31:03.695398 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-2fbc14da-d930-4f05-87d4-efdfcec8f56c tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /compute/v2.1/servers/ebdfbba3-0077-46f6-af60-35f085357682" status: 200 len: 1575 microversion: 2.1 time: 0.223704 Dec 14 03:31:03.699033 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 670/1367] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:31:03 2021] GET /compute/v2.1/servers/ebdfbba3-0077-46f6-af60-35f085357682 => generated 1575 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:31:04.301617 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-aeed4747-df11-4820-9de9-4b88399ed3b2 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:31:04.302163 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-aeed4747-df11-4820-9de9-4b88399ed3b2 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] [instance: b8269bb0-71ca-4269-ae95-6ccd9614cf1e] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:31:04.308405 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-aeed4747-df11-4820-9de9-4b88399ed3b2 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:31:04.308853 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-aeed4747-df11-4820-9de9-4b88399ed3b2 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:31:04.309626 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-aeed4747-df11-4820-9de9-4b88399ed3b2 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:31:04.310068 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-aeed4747-df11-4820-9de9-4b88399ed3b2 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:31:04.438903 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-aeed4747-df11-4820-9de9-4b88399ed3b2 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf869873369f496e9e25a6d6b2a7ba86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:31:04.447242 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-aeed4747-df11-4820-9de9-4b88399ed3b2 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /compute/v2.1/servers/b8269bb0-71ca-4269-ae95-6ccd9614cf1e" status: 200 len: 1459 microversion: 2.1 time: 0.148833 Dec 14 03:31:04.447802 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 698/1368] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:31:04 2021] GET /compute/v2.1/servers/b8269bb0-71ca-4269-ae95-6ccd9614cf1e => generated 1459 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:31:04.713522 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-bc732f94-8815-4839-a1b9-1b53cb2bafa9 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:31:04.714145 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-bc732f94-8815-4839-a1b9-1b53cb2bafa9 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] [instance: ebdfbba3-0077-46f6-af60-35f085357682] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:31:04.720410 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-bc732f94-8815-4839-a1b9-1b53cb2bafa9 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:31:04.720867 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-bc732f94-8815-4839-a1b9-1b53cb2bafa9 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:31:04.721650 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-bc732f94-8815-4839-a1b9-1b53cb2bafa9 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:31:04.722092 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-bc732f94-8815-4839-a1b9-1b53cb2bafa9 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:31:04.848774 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-bc732f94-8815-4839-a1b9-1b53cb2bafa9 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82d0b9a044e43fba9a353b54b74c680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:31:04.856905 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-bc732f94-8815-4839-a1b9-1b53cb2bafa9 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /compute/v2.1/servers/ebdfbba3-0077-46f6-af60-35f085357682" status: 200 len: 1575 microversion: 2.1 time: 0.147577 Dec 14 03:31:04.857510 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 671/1369] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:31:04 2021] GET /compute/v2.1/servers/ebdfbba3-0077-46f6-af60-35f085357682 => generated 1575 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:31:05.311748 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [req-66e18e2c-6147-4d78-a905-fa557125d172 req-37722fb0-f27f-48fd-adb0-ffa0399490c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8269bb0-71ca-4269-ae95-6ccd9614cf1e", "name": "network-vif-deleted", "tag": "d552dc2f-b498-4237-8e44-bcc35ae08483"}]} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:31:05.313340 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:31:05.313340 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: warnings.warn(msg) Dec 14 03:31:05.323055 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-66e18e2c-6147-4d78-a905-fa557125d172 req-37722fb0-f27f-48fd-adb0-ffa0399490c6 service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:31:05.323508 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-66e18e2c-6147-4d78-a905-fa557125d172 req-37722fb0-f27f-48fd-adb0-ffa0399490c6 service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:31:05.334991 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.compute.server_external_events [req-66e18e2c-6147-4d78-a905-fa557125d172 req-37722fb0-f27f-48fd-adb0-ffa0399490c6 service nova] Creating event network-vif-deleted:d552dc2f-b498-4237-8e44-bcc35ae08483 for instance b8269bb0-71ca-4269-ae95-6ccd9614cf1e on hv-cinder-81803 Dec 14 03:31:05.340544 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [req-66e18e2c-6147-4d78-a905-fa557125d172 req-37722fb0-f27f-48fd-adb0-ffa0399490c6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032332 Dec 14 03:31:05.341180 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 699/1370] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Dec 14 03:31:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:31:05.465533 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-f545e974-6dd6-4aa8-ab73-371b11321080 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:31:05.466161 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-f545e974-6dd6-4aa8-ab73-371b11321080 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] [instance: b8269bb0-71ca-4269-ae95-6ccd9614cf1e] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:31:05.472228 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-f545e974-6dd6-4aa8-ab73-371b11321080 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:31:05.472713 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-f545e974-6dd6-4aa8-ab73-371b11321080 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:31:05.473507 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-f545e974-6dd6-4aa8-ab73-371b11321080 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:31:05.473949 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-f545e974-6dd6-4aa8-ab73-371b11321080 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:31:05.533106 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-f545e974-6dd6-4aa8-ab73-371b11321080 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf869873369f496e9e25a6d6b2a7ba86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:31:05.540336 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-f545e974-6dd6-4aa8-ab73-371b11321080 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /compute/v2.1/servers/b8269bb0-71ca-4269-ae95-6ccd9614cf1e" status: 200 len: 1225 microversion: 2.1 time: 0.078474 Dec 14 03:31:05.540896 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 672/1371] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:31:05 2021] GET /compute/v2.1/servers/b8269bb0-71ca-4269-ae95-6ccd9614cf1e => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:31:05.874509 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-209eed4e-afd6-49d0-b32a-ade51e3655fd tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:31:05.875188 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-209eed4e-afd6-49d0-b32a-ade51e3655fd tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] [instance: ebdfbba3-0077-46f6-af60-35f085357682] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:31:05.881240 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-209eed4e-afd6-49d0-b32a-ade51e3655fd tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:31:05.881691 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-209eed4e-afd6-49d0-b32a-ade51e3655fd tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:31:05.882460 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-209eed4e-afd6-49d0-b32a-ade51e3655fd tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:31:05.882897 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-209eed4e-afd6-49d0-b32a-ade51e3655fd tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:31:06.015244 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-209eed4e-afd6-49d0-b32a-ade51e3655fd tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82d0b9a044e43fba9a353b54b74c680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:31:06.022693 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-209eed4e-afd6-49d0-b32a-ade51e3655fd tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /compute/v2.1/servers/ebdfbba3-0077-46f6-af60-35f085357682" status: 200 len: 1575 microversion: 2.1 time: 0.152235 Dec 14 03:31:06.023268 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 700/1372] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:31:05 2021] GET /compute/v2.1/servers/ebdfbba3-0077-46f6-af60-35f085357682 => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:31:06.556857 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-dcc2b394-f59d-4301-b817-2ec019587466 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:31:06.557482 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-dcc2b394-f59d-4301-b817-2ec019587466 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] [instance: b8269bb0-71ca-4269-ae95-6ccd9614cf1e] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:31:06.563752 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-dcc2b394-f59d-4301-b817-2ec019587466 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:31:06.564209 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-dcc2b394-f59d-4301-b817-2ec019587466 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:31:06.564992 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-dcc2b394-f59d-4301-b817-2ec019587466 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:31:06.565435 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-dcc2b394-f59d-4301-b817-2ec019587466 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:31:06.578859 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.wsgi [None req-dcc2b394-f59d-4301-b817-2ec019587466 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] HTTP exception thrown: Instance b8269bb0-71ca-4269-ae95-6ccd9614cf1e could not be found. Dec 14 03:31:06.579470 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-dcc2b394-f59d-4301-b817-2ec019587466 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Returning 404 to user: Instance b8269bb0-71ca-4269-ae95-6ccd9614cf1e could not be found. {{(pid=116071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 03:31:06.580276 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-dcc2b394-f59d-4301-b817-2ec019587466 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /compute/v2.1/servers/b8269bb0-71ca-4269-ae95-6ccd9614cf1e" status: 404 len: 111 microversion: 2.1 time: 0.027119 Dec 14 03:31:06.580805 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 673/1373] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:31:06 2021] GET /compute/v2.1/servers/b8269bb0-71ca-4269-ae95-6ccd9614cf1e => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 14 03:31:07.039514 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-b598005f-a19d-4f48-a8e2-af457002adee tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:31:07.040200 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-b598005f-a19d-4f48-a8e2-af457002adee tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] [instance: ebdfbba3-0077-46f6-af60-35f085357682] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:31:07.046887 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b598005f-a19d-4f48-a8e2-af457002adee tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:31:07.047375 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b598005f-a19d-4f48-a8e2-af457002adee tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:31:07.048150 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b598005f-a19d-4f48-a8e2-af457002adee tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:31:07.048587 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b598005f-a19d-4f48-a8e2-af457002adee tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:31:07.176209 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-b598005f-a19d-4f48-a8e2-af457002adee tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82d0b9a044e43fba9a353b54b74c680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:31:07.183999 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-b598005f-a19d-4f48-a8e2-af457002adee tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /compute/v2.1/servers/ebdfbba3-0077-46f6-af60-35f085357682" status: 200 len: 1575 microversion: 2.1 time: 0.148098 Dec 14 03:31:07.184561 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 701/1374] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:31:07 2021] GET /compute/v2.1/servers/ebdfbba3-0077-46f6-af60-35f085357682 => generated 1575 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:31:08.201023 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-258ac0e9-f1c8-4ba7-9011-46fda41c83cc tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:31:08.201635 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-258ac0e9-f1c8-4ba7-9011-46fda41c83cc tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] [instance: ebdfbba3-0077-46f6-af60-35f085357682] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:31:08.207827 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-258ac0e9-f1c8-4ba7-9011-46fda41c83cc tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:31:08.208281 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-258ac0e9-f1c8-4ba7-9011-46fda41c83cc tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:31:08.209057 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-258ac0e9-f1c8-4ba7-9011-46fda41c83cc tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:31:08.209495 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-258ac0e9-f1c8-4ba7-9011-46fda41c83cc tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:31:08.336885 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-258ac0e9-f1c8-4ba7-9011-46fda41c83cc tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82d0b9a044e43fba9a353b54b74c680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:31:08.344123 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-258ac0e9-f1c8-4ba7-9011-46fda41c83cc tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /compute/v2.1/servers/ebdfbba3-0077-46f6-af60-35f085357682" status: 200 len: 1575 microversion: 2.1 time: 0.147354 Dec 14 03:31:08.344693 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 674/1375] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:31:08 2021] GET /compute/v2.1/servers/ebdfbba3-0077-46f6-af60-35f085357682 => generated 1575 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:31:09.361763 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-4a28adbc-2de3-4d6b-bd5a-743327ee346b tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:31:09.362570 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-4a28adbc-2de3-4d6b-bd5a-743327ee346b tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] [instance: ebdfbba3-0077-46f6-af60-35f085357682] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:31:09.369262 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4a28adbc-2de3-4d6b-bd5a-743327ee346b tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:31:09.369785 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4a28adbc-2de3-4d6b-bd5a-743327ee346b tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:31:09.370566 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4a28adbc-2de3-4d6b-bd5a-743327ee346b tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:31:09.370994 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4a28adbc-2de3-4d6b-bd5a-743327ee346b tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:31:09.502194 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-4a28adbc-2de3-4d6b-bd5a-743327ee346b tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82d0b9a044e43fba9a353b54b74c680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:31:09.509388 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-4a28adbc-2de3-4d6b-bd5a-743327ee346b tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /compute/v2.1/servers/ebdfbba3-0077-46f6-af60-35f085357682" status: 200 len: 1575 microversion: 2.1 time: 0.151509 Dec 14 03:31:09.509952 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 702/1376] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:31:09 2021] GET /compute/v2.1/servers/ebdfbba3-0077-46f6-af60-35f085357682 => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:31:09.612516 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-6f9223e7-cb1f-4df0-95cb-8332ffab2318 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:31:09.613015 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-6f9223e7-cb1f-4df0-95cb-8332ffab2318 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] [instance: c2f38df0-5498-4c35-8e93-0221c7e54271] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:31:09.615924 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [req-7bf74ac3-7a80-46e5-8865-0748a397a982 req-4ac66a64-952e-493f-aca4-f288e0c96ef5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2f38df0-5498-4c35-8e93-0221c7e54271", "tag": "15eacb4a-a968-4c7a-8e62-e27f90bfd84e"}]} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:31:09.617839 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:31:09.617839 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: warnings.warn(msg) Dec 14 03:31:09.619874 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-6f9223e7-cb1f-4df0-95cb-8332ffab2318 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:31:09.620330 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-6f9223e7-cb1f-4df0-95cb-8332ffab2318 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:31:09.621103 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-6f9223e7-cb1f-4df0-95cb-8332ffab2318 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:31:09.621758 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-6f9223e7-cb1f-4df0-95cb-8332ffab2318 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:31:09.624995 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-7bf74ac3-7a80-46e5-8865-0748a397a982 req-4ac66a64-952e-493f-aca4-f288e0c96ef5 service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:31:09.625513 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-7bf74ac3-7a80-46e5-8865-0748a397a982 req-4ac66a64-952e-493f-aca4-f288e0c96ef5 service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:31:09.637611 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.compute.server_external_events [req-7bf74ac3-7a80-46e5-8865-0748a397a982 req-4ac66a64-952e-493f-aca4-f288e0c96ef5 service nova] Creating event network-changed:15eacb4a-a968-4c7a-8e62-e27f90bfd84e for instance c2f38df0-5498-4c35-8e93-0221c7e54271 on hv-cinder-81803 Dec 14 03:31:09.642577 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [req-7bf74ac3-7a80-46e5-8865-0748a397a982 req-4ac66a64-952e-493f-aca4-f288e0c96ef5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031190 Dec 14 03:31:09.643194 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 703/1377] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Dec 14 03:31:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:31:09.647014 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-6f9223e7-cb1f-4df0-95cb-8332ffab2318 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] [instance: c2f38df0-5498-4c35-8e93-0221c7e54271] Going to try to terminate instance {{(pid=116071) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 14 03:31:09.726754 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-6f9223e7-cb1f-4df0-95cb-8332ffab2318 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "DELETE /compute/v2.1/servers/c2f38df0-5498-4c35-8e93-0221c7e54271" status: 204 len: 0 microversion: 2.1 time: 0.117469 Dec 14 03:31:09.731203 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 675/1378] 10.222.0.43 () {58 vars in 1238 bytes} [Tue Dec 14 03:31:09 2021] DELETE /compute/v2.1/servers/c2f38df0-5498-4c35-8e93-0221c7e54271 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 14 03:31:09.736753 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-f846ef8b-b341-478c-8176-573a39bb80d2 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:31:09.737466 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-f846ef8b-b341-478c-8176-573a39bb80d2 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] [instance: c2f38df0-5498-4c35-8e93-0221c7e54271] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:31:09.745397 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f846ef8b-b341-478c-8176-573a39bb80d2 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:31:09.745397 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f846ef8b-b341-478c-8176-573a39bb80d2 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:31:09.746268 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f846ef8b-b341-478c-8176-573a39bb80d2 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:31:09.746735 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f846ef8b-b341-478c-8176-573a39bb80d2 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:31:09.951767 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-f846ef8b-b341-478c-8176-573a39bb80d2 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf869873369f496e9e25a6d6b2a7ba86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:31:09.959285 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-f846ef8b-b341-478c-8176-573a39bb80d2 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /compute/v2.1/servers/c2f38df0-5498-4c35-8e93-0221c7e54271" status: 200 len: 1576 microversion: 2.1 time: 0.226691 Dec 14 03:31:09.960001 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 704/1379] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:31:09 2021] GET /compute/v2.1/servers/c2f38df0-5498-4c35-8e93-0221c7e54271 => generated 1576 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:31:10.527865 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-2376a428-7026-409c-a6cf-1dfb066d1c79 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:31:10.528575 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-2376a428-7026-409c-a6cf-1dfb066d1c79 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] [instance: ebdfbba3-0077-46f6-af60-35f085357682] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:31:10.534669 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-2376a428-7026-409c-a6cf-1dfb066d1c79 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:31:10.535151 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-2376a428-7026-409c-a6cf-1dfb066d1c79 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:31:10.535958 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-2376a428-7026-409c-a6cf-1dfb066d1c79 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:31:10.536409 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-2376a428-7026-409c-a6cf-1dfb066d1c79 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:31:10.687449 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-2376a428-7026-409c-a6cf-1dfb066d1c79 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82d0b9a044e43fba9a353b54b74c680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:31:10.695348 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-2376a428-7026-409c-a6cf-1dfb066d1c79 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /compute/v2.1/servers/ebdfbba3-0077-46f6-af60-35f085357682" status: 200 len: 1575 microversion: 2.1 time: 0.171975 Dec 14 03:31:10.695922 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 676/1380] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:31:10 2021] GET /compute/v2.1/servers/ebdfbba3-0077-46f6-af60-35f085357682 => generated 1575 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:31:10.715371 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [req-121ea182-9845-49c3-8ac3-19a8351ff87f req-4bfe2d50-2558-47a5-9132-227ece69d250 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebdfbba3-0077-46f6-af60-35f085357682", "name": "network-vif-plugged", "status": "completed", "tag": "f5625fc9-aa99-4f98-9a5d-b0f54296bb68"}]} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:31:10.717535 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:31:10.717535 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: warnings.warn(msg) Dec 14 03:31:10.724848 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-121ea182-9845-49c3-8ac3-19a8351ff87f req-4bfe2d50-2558-47a5-9132-227ece69d250 service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:31:10.725287 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-121ea182-9845-49c3-8ac3-19a8351ff87f req-4bfe2d50-2558-47a5-9132-227ece69d250 service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:31:10.737899 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.compute.server_external_events [req-121ea182-9845-49c3-8ac3-19a8351ff87f req-4bfe2d50-2558-47a5-9132-227ece69d250 service nova] Creating event network-vif-plugged:f5625fc9-aa99-4f98-9a5d-b0f54296bb68 for instance ebdfbba3-0077-46f6-af60-35f085357682 on hv-cinder-81803 Dec 14 03:31:10.742903 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [req-121ea182-9845-49c3-8ac3-19a8351ff87f req-4bfe2d50-2558-47a5-9132-227ece69d250 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031697 Dec 14 03:31:10.743529 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 705/1381] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Dec 14 03:31:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:31:10.976099 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-338b35db-3e8d-4af0-a528-55f51c3d4c0b tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:31:10.976823 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-338b35db-3e8d-4af0-a528-55f51c3d4c0b tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] [instance: c2f38df0-5498-4c35-8e93-0221c7e54271] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:31:10.982525 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-338b35db-3e8d-4af0-a528-55f51c3d4c0b tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:31:10.982980 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-338b35db-3e8d-4af0-a528-55f51c3d4c0b tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:31:10.983801 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-338b35db-3e8d-4af0-a528-55f51c3d4c0b tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:31:10.984245 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-338b35db-3e8d-4af0-a528-55f51c3d4c0b tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:31:11.157480 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-338b35db-3e8d-4af0-a528-55f51c3d4c0b tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf869873369f496e9e25a6d6b2a7ba86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:31:11.164684 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-338b35db-3e8d-4af0-a528-55f51c3d4c0b tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /compute/v2.1/servers/c2f38df0-5498-4c35-8e93-0221c7e54271" status: 200 len: 1458 microversion: 2.1 time: 0.192284 Dec 14 03:31:11.165238 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 677/1382] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:31:10 2021] GET /compute/v2.1/servers/c2f38df0-5498-4c35-8e93-0221c7e54271 => generated 1458 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:31:11.712974 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-76111303-dd05-4617-b3f0-e5487c53e272 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:31:11.713602 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-76111303-dd05-4617-b3f0-e5487c53e272 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] [instance: ebdfbba3-0077-46f6-af60-35f085357682] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:31:11.719628 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-76111303-dd05-4617-b3f0-e5487c53e272 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:31:11.720193 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-76111303-dd05-4617-b3f0-e5487c53e272 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:31:11.720829 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-76111303-dd05-4617-b3f0-e5487c53e272 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:31:11.721258 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-76111303-dd05-4617-b3f0-e5487c53e272 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:31:11.851952 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-76111303-dd05-4617-b3f0-e5487c53e272 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82d0b9a044e43fba9a353b54b74c680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:31:11.859611 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-76111303-dd05-4617-b3f0-e5487c53e272 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /compute/v2.1/servers/ebdfbba3-0077-46f6-af60-35f085357682" status: 200 len: 1575 microversion: 2.1 time: 0.150695 Dec 14 03:31:11.860174 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 706/1383] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:31:11 2021] GET /compute/v2.1/servers/ebdfbba3-0077-46f6-af60-35f085357682 => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:31:12.181014 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-54cbf6af-91a4-49fc-8ca4-b83dfdfdc10c tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:31:12.181694 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-54cbf6af-91a4-49fc-8ca4-b83dfdfdc10c tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] [instance: c2f38df0-5498-4c35-8e93-0221c7e54271] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:31:12.187760 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-54cbf6af-91a4-49fc-8ca4-b83dfdfdc10c tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:31:12.188151 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-54cbf6af-91a4-49fc-8ca4-b83dfdfdc10c tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:31:12.188940 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-54cbf6af-91a4-49fc-8ca4-b83dfdfdc10c tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:31:12.189378 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-54cbf6af-91a4-49fc-8ca4-b83dfdfdc10c tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:31:12.255871 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-54cbf6af-91a4-49fc-8ca4-b83dfdfdc10c tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf869873369f496e9e25a6d6b2a7ba86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c4dcf4957d42b896f04f682afeef7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:31:12.263106 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-54cbf6af-91a4-49fc-8ca4-b83dfdfdc10c tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /compute/v2.1/servers/c2f38df0-5498-4c35-8e93-0221c7e54271" status: 200 len: 1391 microversion: 2.1 time: 0.085911 Dec 14 03:31:12.263676 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 678/1384] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:31:12 2021] GET /compute/v2.1/servers/c2f38df0-5498-4c35-8e93-0221c7e54271 => generated 1391 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:31:12.334150 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [req-68556a6e-3cd5-45c8-a8c4-e86e085c1776 req-cdc0689e-3f1e-4907-a978-1f14ce260205 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2f38df0-5498-4c35-8e93-0221c7e54271", "name": "network-vif-deleted", "tag": "15eacb4a-a968-4c7a-8e62-e27f90bfd84e"}]} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:31:12.335677 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:31:12.335677 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: warnings.warn(msg) Dec 14 03:31:12.344571 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-68556a6e-3cd5-45c8-a8c4-e86e085c1776 req-cdc0689e-3f1e-4907-a978-1f14ce260205 service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:31:12.345126 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-68556a6e-3cd5-45c8-a8c4-e86e085c1776 req-cdc0689e-3f1e-4907-a978-1f14ce260205 service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:31:12.358455 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.compute.server_external_events [req-68556a6e-3cd5-45c8-a8c4-e86e085c1776 req-cdc0689e-3f1e-4907-a978-1f14ce260205 service nova] Creating event network-vif-deleted:15eacb4a-a968-4c7a-8e62-e27f90bfd84e for instance c2f38df0-5498-4c35-8e93-0221c7e54271 on hv-cinder-81803 Dec 14 03:31:12.365229 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [req-68556a6e-3cd5-45c8-a8c4-e86e085c1776 req-cdc0689e-3f1e-4907-a978-1f14ce260205 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034682 Dec 14 03:31:12.366399 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 707/1385] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Dec 14 03:31:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:31:12.877515 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-0087da00-94de-4187-87a5-3afbab232fd6 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:31:12.878072 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-0087da00-94de-4187-87a5-3afbab232fd6 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] [instance: ebdfbba3-0077-46f6-af60-35f085357682] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:31:12.883987 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-0087da00-94de-4187-87a5-3afbab232fd6 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:31:12.884445 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-0087da00-94de-4187-87a5-3afbab232fd6 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:31:12.885814 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-0087da00-94de-4187-87a5-3afbab232fd6 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:31:12.886259 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-0087da00-94de-4187-87a5-3afbab232fd6 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:31:13.014722 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-0087da00-94de-4187-87a5-3afbab232fd6 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82d0b9a044e43fba9a353b54b74c680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:31:13.022861 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-0087da00-94de-4187-87a5-3afbab232fd6 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /compute/v2.1/servers/ebdfbba3-0077-46f6-af60-35f085357682" status: 200 len: 1562 microversion: 2.1 time: 0.149226 Dec 14 03:31:13.023468 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 679/1386] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:31:12 2021] GET /compute/v2.1/servers/ebdfbba3-0077-46f6-af60-35f085357682 => generated 1562 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:31:13.280602 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-4e5405f1-6340-4e26-aee3-a38ea8c45c24 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:31:13.281219 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-4e5405f1-6340-4e26-aee3-a38ea8c45c24 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] [instance: c2f38df0-5498-4c35-8e93-0221c7e54271] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:31:13.287717 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4e5405f1-6340-4e26-aee3-a38ea8c45c24 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:31:13.288168 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4e5405f1-6340-4e26-aee3-a38ea8c45c24 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:31:13.288939 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4e5405f1-6340-4e26-aee3-a38ea8c45c24 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:31:13.289374 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4e5405f1-6340-4e26-aee3-a38ea8c45c24 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:31:13.302155 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.wsgi [None req-4e5405f1-6340-4e26-aee3-a38ea8c45c24 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] HTTP exception thrown: Instance c2f38df0-5498-4c35-8e93-0221c7e54271 could not be found. Dec 14 03:31:13.302734 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-4e5405f1-6340-4e26-aee3-a38ea8c45c24 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Returning 404 to user: Instance c2f38df0-5498-4c35-8e93-0221c7e54271 could not be found. {{(pid=116072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 03:31:13.303601 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-4e5405f1-6340-4e26-aee3-a38ea8c45c24 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /compute/v2.1/servers/c2f38df0-5498-4c35-8e93-0221c7e54271" status: 404 len: 111 microversion: 2.1 time: 0.027634 Dec 14 03:31:13.304125 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 708/1387] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:31:13 2021] GET /compute/v2.1/servers/c2f38df0-5498-4c35-8e93-0221c7e54271 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 14 03:31:13.738598 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-19a6a275-9ab6-4a4f-9656-0e116be1b05b tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:31:13.739409 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-19a6a275-9ab6-4a4f-9656-0e116be1b05b tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] [instance: 76d36b1d-a395-46b5-b80d-9fa1871c0873] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:31:13.746046 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-19a6a275-9ab6-4a4f-9656-0e116be1b05b tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:31:13.746495 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-19a6a275-9ab6-4a4f-9656-0e116be1b05b tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:31:13.747303 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-19a6a275-9ab6-4a4f-9656-0e116be1b05b tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:31:13.747737 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-19a6a275-9ab6-4a4f-9656-0e116be1b05b tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:31:13.761167 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.wsgi [None req-19a6a275-9ab6-4a4f-9656-0e116be1b05b tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] HTTP exception thrown: Instance 76d36b1d-a395-46b5-b80d-9fa1871c0873 could not be found. Dec 14 03:31:13.761736 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-19a6a275-9ab6-4a4f-9656-0e116be1b05b tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Returning 404 to user: Instance 76d36b1d-a395-46b5-b80d-9fa1871c0873 could not be found. {{(pid=116071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 03:31:13.762533 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-19a6a275-9ab6-4a4f-9656-0e116be1b05b tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "DELETE /compute/v2.1/servers/76d36b1d-a395-46b5-b80d-9fa1871c0873" status: 404 len: 111 microversion: 2.1 time: 0.027635 Dec 14 03:31:13.763062 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 680/1388] 10.222.0.43 () {58 vars in 1238 bytes} [Tue Dec 14 03:31:13 2021] DELETE /compute/v2.1/servers/76d36b1d-a395-46b5-b80d-9fa1871c0873 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 14 03:31:13.770827 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-328cce5f-ef78-47f1-ae11-f51b5e2f514d tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:31:13.771509 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-328cce5f-ef78-47f1-ae11-f51b5e2f514d tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] [instance: 76d36b1d-a395-46b5-b80d-9fa1871c0873] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:31:13.777216 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-328cce5f-ef78-47f1-ae11-f51b5e2f514d tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:31:13.777670 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-328cce5f-ef78-47f1-ae11-f51b5e2f514d tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:31:13.778445 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-328cce5f-ef78-47f1-ae11-f51b5e2f514d tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:31:13.778885 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-328cce5f-ef78-47f1-ae11-f51b5e2f514d tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:31:13.791683 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.wsgi [None req-328cce5f-ef78-47f1-ae11-f51b5e2f514d tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] HTTP exception thrown: Instance 76d36b1d-a395-46b5-b80d-9fa1871c0873 could not be found. Dec 14 03:31:13.792255 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-328cce5f-ef78-47f1-ae11-f51b5e2f514d tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Returning 404 to user: Instance 76d36b1d-a395-46b5-b80d-9fa1871c0873 could not be found. {{(pid=116072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 03:31:13.793049 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-328cce5f-ef78-47f1-ae11-f51b5e2f514d tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "GET /compute/v2.1/servers/76d36b1d-a395-46b5-b80d-9fa1871c0873" status: 404 len: 111 microversion: 2.1 time: 0.025920 Dec 14 03:31:13.793562 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 709/1389] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:31:13 2021] GET /compute/v2.1/servers/76d36b1d-a395-46b5-b80d-9fa1871c0873 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 14 03:31:15.062894 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-740b35eb-ca5f-4598-bdb7-5719223705e9 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] Calling method '.version_select at 0x7fa50376f5e0>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:31:15.066039 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: ERROR oslo.messaging._drivers.impl_rabbit [None req-740b35eb-ca5f-4598-bdb7-5719223705e9 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] [d3ed6ad1-dcb1-49b1-9b39-21dd3d01e496] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 14 03:31:16.082002 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO oslo.messaging._drivers.impl_rabbit [None req-740b35eb-ca5f-4598-bdb7-5719223705e9 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] [d3ed6ad1-dcb1-49b1-9b39-21dd3d01e496] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 36564. Dec 14 03:31:16.100535 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-740b35eb-ca5f-4598-bdb7-5719223705e9 tempest-TestVolumeBootPattern-2080315832 tempest-TestVolumeBootPattern-2080315832-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-801497898" status: 202 len: 0 microversion: 2.1 time: 1.041355 Dec 14 03:31:16.101092 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 681/1390] 10.222.0.43 () {58 vars in 1259 bytes} [Tue Dec 14 03:31:15 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-801497898 => generated 0 bytes in 1043 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:32:42.678645 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-30920794-f156-4429-8365-e35ed58448e6 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:32:42.679177 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-30920794-f156-4429-8365-e35ed58448e6 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] [instance: ebdfbba3-0077-46f6-af60-35f085357682] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:32:42.683530 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [req-f0d4b56d-0b00-4078-93a0-01431ca0b8ee req-434d4199-ffdb-4660-88ec-115445df64f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebdfbba3-0077-46f6-af60-35f085357682", "tag": "f5625fc9-aa99-4f98-9a5d-b0f54296bb68"}]} {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:32:42.685042 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:32:42.685042 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: warnings.warn(msg) Dec 14 03:32:42.686140 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-30920794-f156-4429-8365-e35ed58448e6 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:32:42.686801 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-30920794-f156-4429-8365-e35ed58448e6 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:32:42.687625 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-30920794-f156-4429-8365-e35ed58448e6 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:32:42.688417 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-30920794-f156-4429-8365-e35ed58448e6 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:32:42.691918 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [req-f0d4b56d-0b00-4078-93a0-01431ca0b8ee req-434d4199-ffdb-4660-88ec-115445df64f8 service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:32:42.692367 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [req-f0d4b56d-0b00-4078-93a0-01431ca0b8ee req-434d4199-ffdb-4660-88ec-115445df64f8 service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:32:42.704608 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.compute.server_external_events [req-f0d4b56d-0b00-4078-93a0-01431ca0b8ee req-434d4199-ffdb-4660-88ec-115445df64f8 service nova] Creating event network-changed:f5625fc9-aa99-4f98-9a5d-b0f54296bb68 for instance ebdfbba3-0077-46f6-af60-35f085357682 on hv-cinder-81803 Dec 14 03:32:42.710023 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [req-f0d4b56d-0b00-4078-93a0-01431ca0b8ee req-434d4199-ffdb-4660-88ec-115445df64f8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032080 Dec 14 03:32:42.711582 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 682/1391] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Dec 14 03:32:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 03:32:42.720638 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-30920794-f156-4429-8365-e35ed58448e6 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] [instance: ebdfbba3-0077-46f6-af60-35f085357682] Going to try to terminate instance {{(pid=116072) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 14 03:32:42.809302 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-30920794-f156-4429-8365-e35ed58448e6 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "DELETE /compute/v2.1/servers/ebdfbba3-0077-46f6-af60-35f085357682" status: 204 len: 0 microversion: 2.1 time: 0.134927 Dec 14 03:32:42.811084 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 710/1392] 10.222.0.43 () {58 vars in 1238 bytes} [Tue Dec 14 03:32:42 2021] DELETE /compute/v2.1/servers/ebdfbba3-0077-46f6-af60-35f085357682 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 14 03:32:42.820457 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-c5a366dc-ec1b-4b34-9334-74363704de4a tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:32:42.821605 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-c5a366dc-ec1b-4b34-9334-74363704de4a tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] [instance: ebdfbba3-0077-46f6-af60-35f085357682] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:32:42.828438 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c5a366dc-ec1b-4b34-9334-74363704de4a tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:32:42.828893 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c5a366dc-ec1b-4b34-9334-74363704de4a tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:32:42.829702 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c5a366dc-ec1b-4b34-9334-74363704de4a tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:32:42.830121 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-c5a366dc-ec1b-4b34-9334-74363704de4a tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:32:43.067482 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-c5a366dc-ec1b-4b34-9334-74363704de4a tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82d0b9a044e43fba9a353b54b74c680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:32:43.075948 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-c5a366dc-ec1b-4b34-9334-74363704de4a tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /compute/v2.1/servers/ebdfbba3-0077-46f6-af60-35f085357682" status: 200 len: 1568 microversion: 2.1 time: 0.261296 Dec 14 03:32:43.076646 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 683/1393] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:32:42 2021] GET /compute/v2.1/servers/ebdfbba3-0077-46f6-af60-35f085357682 => generated 1568 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:32:44.094804 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-4c613836-2eda-4a04-8c58-43aefa8615f1 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:32:44.095536 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-4c613836-2eda-4a04-8c58-43aefa8615f1 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] [instance: ebdfbba3-0077-46f6-af60-35f085357682] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:32:44.101891 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4c613836-2eda-4a04-8c58-43aefa8615f1 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:32:44.102343 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4c613836-2eda-4a04-8c58-43aefa8615f1 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:32:44.103173 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4c613836-2eda-4a04-8c58-43aefa8615f1 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:32:44.103610 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4c613836-2eda-4a04-8c58-43aefa8615f1 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:32:44.235563 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-4c613836-2eda-4a04-8c58-43aefa8615f1 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82d0b9a044e43fba9a353b54b74c680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:32:44.243943 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-4c613836-2eda-4a04-8c58-43aefa8615f1 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /compute/v2.1/servers/ebdfbba3-0077-46f6-af60-35f085357682" status: 200 len: 1450 microversion: 2.1 time: 0.153097 Dec 14 03:32:44.244504 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 711/1394] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:32:44 2021] GET /compute/v2.1/servers/ebdfbba3-0077-46f6-af60-35f085357682 => generated 1450 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:32:45.261066 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-816facf5-51ba-41a7-8729-500310b318a8 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:32:45.261681 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-816facf5-51ba-41a7-8729-500310b318a8 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] [instance: ebdfbba3-0077-46f6-af60-35f085357682] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:32:45.267862 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-816facf5-51ba-41a7-8729-500310b318a8 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:32:45.268310 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-816facf5-51ba-41a7-8729-500310b318a8 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:32:45.269091 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-816facf5-51ba-41a7-8729-500310b318a8 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:32:45.269525 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-816facf5-51ba-41a7-8729-500310b318a8 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:32:45.339341 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [req-c01315c1-e7a5-4fdc-876c-408b91302718 req-be1f3af8-c02b-409f-b880-87c74644ea7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebdfbba3-0077-46f6-af60-35f085357682", "name": "network-vif-deleted", "tag": "f5625fc9-aa99-4f98-9a5d-b0f54296bb68"}]} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 03:32:45.340862 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 03:32:45.340862 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: warnings.warn(msg) Dec 14 03:32:45.348325 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-c01315c1-e7a5-4fdc-876c-408b91302718 req-be1f3af8-c02b-409f-b880-87c74644ea7c service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:32:45.348773 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-c01315c1-e7a5-4fdc-876c-408b91302718 req-be1f3af8-c02b-409f-b880-87c74644ea7c service nova] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:32:45.354649 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.policy [None req-816facf5-51ba-41a7-8729-500310b318a8 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82d0b9a044e43fba9a353b54b74c680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ffd96b68cf41c5a9be418ed8c0c61a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116071) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 03:32:45.361661 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.compute.server_external_events [req-c01315c1-e7a5-4fdc-876c-408b91302718 req-be1f3af8-c02b-409f-b880-87c74644ea7c service nova] Creating event network-vif-deleted:f5625fc9-aa99-4f98-9a5d-b0f54296bb68 for instance ebdfbba3-0077-46f6-af60-35f085357682 on hv-cinder-81803 Dec 14 03:32:45.364646 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-816facf5-51ba-41a7-8729-500310b318a8 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /compute/v2.1/servers/ebdfbba3-0077-46f6-af60-35f085357682" status: 200 len: 1382 microversion: 2.1 time: 0.107584 Dec 14 03:32:45.365757 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 684/1395] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:32:45 2021] GET /compute/v2.1/servers/ebdfbba3-0077-46f6-af60-35f085357682 => generated 1382 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 03:32:45.366873 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [req-c01315c1-e7a5-4fdc-876c-408b91302718 req-be1f3af8-c02b-409f-b880-87c74644ea7c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031331 Dec 14 03:32:45.368112 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 712/1396] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Dec 14 03:32:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 14 03:32:46.382371 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-a54f7549-ef09-4539-84f0-9c811da2ce44 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Calling method '>' {{(pid=116071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:32:46.383448 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.compute.api [None req-a54f7549-ef09-4539-84f0-9c811da2ce44 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] [instance: ebdfbba3-0077-46f6-af60-35f085357682] Fetching instance by UUID {{(pid=116071) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 14 03:32:46.389775 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a54f7549-ef09-4539-84f0-9c811da2ce44 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:32:46.390230 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a54f7549-ef09-4539-84f0-9c811da2ce44 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:32:46.391010 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a54f7549-ef09-4539-84f0-9c811da2ce44 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 14 03:32:46.391477 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG oslo_concurrency.lockutils [None req-a54f7549-ef09-4539-84f0-9c811da2ce44 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Lock "8f4f9783-5b67-4c46-a873-d02b5f040c2e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 14 03:32:46.405153 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.wsgi [None req-a54f7549-ef09-4539-84f0-9c811da2ce44 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] HTTP exception thrown: Instance ebdfbba3-0077-46f6-af60-35f085357682 could not be found. Dec 14 03:32:46.405789 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: DEBUG nova.api.openstack.wsgi [None req-a54f7549-ef09-4539-84f0-9c811da2ce44 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Returning 404 to user: Instance ebdfbba3-0077-46f6-af60-35f085357682 could not be found. {{(pid=116071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 14 03:32:46.406599 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO nova.api.openstack.requestlog [None req-a54f7549-ef09-4539-84f0-9c811da2ce44 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "GET /compute/v2.1/servers/ebdfbba3-0077-46f6-af60-35f085357682" status: 404 len: 111 microversion: 2.1 time: 0.028000 Dec 14 03:32:46.407134 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: [pid: 116071|app: 0|req: 685/1397] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Dec 14 03:32:46 2021] GET /compute/v2.1/servers/ebdfbba3-0077-46f6-af60-35f085357682 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 14 03:32:46.563501 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-98980543-4b18-421c-a13f-05b1216741d6 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] Calling method '.version_select at 0x7fa50819b0d0>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 03:32:46.585362 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-98980543-4b18-421c-a13f-05b1216741d6 tempest-TestShelveInstance-361277538 tempest-TestShelveInstance-361277538-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1944630018" status: 202 len: 0 microversion: 2.1 time: 0.026489 Dec 14 03:32:46.586007 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 713/1398] 10.222.0.43 () {58 vars in 1253 bytes} [Tue Dec 14 03:32:46 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1944630018 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 14 03:34:49.732825 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 14 03:34:49.733287 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: Tue Dec 14 03:34:49 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 14 03:34:53.655223 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 14 03:34:53.655796 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: Tue Dec 14 03:34:53 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 14 03:35:07.858385 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 14 03:35:07.858929 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: Tue Dec 14 03:35:07 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 14 03:35:22.941870 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 14 03:35:22.942451 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: Tue Dec 14 03:35:22 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 14 03:36:15.366054 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 14 03:36:15.366659 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: Tue Dec 14 03:36:15 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 14 03:36:30.953312 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 14 03:36:30.953871 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: Tue Dec 14 03:36:30 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 14 03:38:09.751139 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 14 03:38:09.751775 dv-cinder-818037-8-iscsi devstack@n-api.service[116071]: Tue Dec 14 03:38:09 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 14 03:38:13.673113 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 14 03:38:13.673618 dv-cinder-818037-8-iscsi devstack@n-api.service[116072]: Tue Dec 14 03:38:13 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!